Product Tiers & Features

Feature enablement and product tier configuration for data sources.

Overview

DataPancake offers multiple product tiers that enable different capabilities for each data source. Schema Discovery is always available at no cost, while other features can be enabled per data source. Features have dependencies—some features automatically enable others.


Schema Discovery (Always Enabled)

Status: Always enabled, no cost (cannot be disabled)

Capabilities:

  • Schema Summary - Overview of discovered attributes and data types

  • Data Source Overview - Summary information on the Data Source Overview screen

  • Basic Attribute Discovery - Identification of attributes and their types

  • Scan History - Record of scans performed on the data source

Limitations:

  • No detailed attribute metadata management

  • No SQL code generation

  • No materialization capabilities

  • No advanced features


Pipeline Designer

Product Tier ID: 0c706118-9450-42f1-b038-70bf15fc41cd

Status: Paid feature, can be enabled per data source

Dependencies: None (but required for other features)

Capabilities:

  • Attribute Metadata Management - Detailed attribute information and configuration

  • Polymorphic Version Tracking - Management of multiple data type versions for attributes

  • Attribute Relationships - Configuration of relationships between attributes

  • Schema Evolution Monitoring - Tracking changes in data structure over time

Auto-Enabled With:

  • SQL Code Generation

  • Data Dictionary Builder

  • Semantic Model Generator

  • Security Policy Integration


SQL Code Generation

Product Tier ID: adf6e297-96af-4ebd-9935-faff9aea3b6d

Status: Paid feature, can be enabled per data source (semi-structured only)

Dependencies: Pipeline Designer (auto-enabled)

Capabilities:

  • Dynamic Table Generation - Generate CREATE DYNAMIC TABLE statements

  • Table Generation - Generate CREATE TABLE statements

  • Nested Array Flattening - Automatic handling of nested arrays

  • Materialization Code - Complete SQL code for materialized objects

  • Code Customization - Configure output object names, deployment locations, and settings

Auto-Enabled With:

  • Semantic Model Generator

  • Security Policy Integration

Configuration Requirements: When SQL Code Generation is enabled, you must configure:

  • Materialization Settings - Output object type, root table name, deployment location

  • Dynamic Table Settings - Warehouse, target lag, optional parameters (if using Dynamic Tables)

  • Source Object Settings - Complete source object configuration

For detailed information on materialization, see Materialization Settings.


Data Dictionary Builder

Product Tier ID: e726d7bf-546f-4d1d-95b2-b678ce2be311

Status: Paid feature, can be enabled per data source

Dependencies: Pipeline Designer (auto-enabled)

Capabilities:

  • Data Dictionary Management - Create and maintain data dictionaries

  • Attribute Documentation - Document attributes with descriptions and metadata

  • Schema Documentation - Comprehensive schema documentation

  • Metadata Management - Rich metadata for attributes and data sources


Security Policy Integration

Product Tier ID: 0c0c61bd-77cd-49c5-8814-042d8f569bfb

Status: Paid feature, can be enabled per data source

Dependencies: Pipeline Designer, SQL Code Generation (both auto-enabled)

Capabilities:

  • Row Access Policy Integration - Include row-level security in generated code

  • Column Masking Policy Integration - Include column masking in generated code

  • Secure View Generation - Generate secure views with security policies

  • Policy Configuration - Configure which attributes use which security policies

For detailed information on secure views, see Secure View Settings.


Semantic Model Generator

Product Tier ID: 9f872063-79a2-44e3-b513-136f9b08ba32

Status: Paid feature, can be enabled per data source

Dependencies: Pipeline Designer, SQL Code Generation, Data Dictionary Builder (all auto-enabled)

Capabilities:

  • Semantic Layer Generation - Create views or materialized views for semantic layer

  • Cortex Analyst Integration - Generate semantic models for Cortex Analyst

  • Relationship Configuration - Define relationships for semantic models

  • Query Generation - Generate verified queries for semantic models

Configuration Requirements: When Semantic Model Generator is enabled, you can configure:

  • View Type - View or Materialized View

  • Root View Name - Name for the root semantic layer view

  • Deployment Location - Database and schema for semantic layer objects

  • Row Access Policy - Security policy for semantic layer views

For detailed information on secure views, see Secure View Settings.


Feature Enablement

Enabling Features: Features are enabled per data source through the Data Source management interface:

  1. Navigate to the Data Source management page

  2. Select or create a data source

  3. Click the "Enable Feature Selection" button

  4. Check the boxes for desired features

  5. Save the data source

Feature Dependencies: The system automatically handles feature dependencies:

  • Enabling SQL Code Generation automatically enables Pipeline Designer

  • Enabling Semantic Model Generator automatically enables Pipeline Designer, SQL Code Generation, and Data Dictionary Builder

  • Enabling Security Policy Integration automatically enables Pipeline Designer and SQL Code Generation

Feature Status:

  • Active - Feature is enabled and available

  • Inactive - Feature is disabled (default for paid features)

Billing: For organizations using billing events (Public Marketplace listing), each enabled feature generates billing events based on the number of attributes in the data source. Schema Discovery is always free. For subscription listings, features are available based on your subscription tier.


Feature Combinations

Basic Materialization:

  • Pipeline Designer (auto-enabled)

  • SQL Code Generation

Complete Solution:

  • Pipeline Designer (auto-enabled)

  • SQL Code Generation

  • Data Dictionary Builder

  • Security Policy Integration

  • Semantic Model Generator

Documentation Only:

  • Pipeline Designer

  • Data Dictionary Builder


Feature Management

Viewing Enabled Features: Enabled features are displayed in the Data Source management interface with checkboxes indicating their status.

Changing Features: Features can be enabled or disabled at any time:

  1. Edit the data source

  2. Click "Enable Feature Selection"

  3. Check or uncheck features as needed

  4. Save changes

Note: Disabling a feature may affect dependent features. The system will warn you if disabling a feature will also disable dependent features.

Feature Impact:

  • Enabling Features: May require additional configuration (e.g., SQL Code Generation requires materialization settings), may enable dependent features automatically, may generate billing events (for billing event organizations)

  • Disabling Features: May disable dependent features, may remove generated code or configurations, does not delete scan history or discovered attributes


Summary

Free Tier:

  • Schema Discovery (always enabled)

Paid Features:

  • Pipeline Designer (foundation feature, auto-enabled with others)

  • SQL Code Generation (materialization, semi-structured only)

  • Data Dictionary Builder (documentation)

  • Security Policy Integration (security)

  • Semantic Model Generator (semantic layer)

Dependencies:

  • Most features require Pipeline Designer (auto-enabled)

  • Advanced features require SQL Code Generation (auto-enabled)

  • Semantic Model Generator requires multiple features (all auto-enabled)

For information on basic configuration, see Basic Configuration Settings. For materialization configuration, see Materialization Settings.

Last updated

Was this helpful?