# Schema Summary Views

## VW\_DATASOURCES

Comprehensive summary of all data sources with configuration and metadata.

**Contents:** Data source identification, source connection details, data format/type, scan statistics, product tier flags, output configuration, metadata table configuration, Gen AI instructions

**Use cases:** Data source inventory, configuration review, product tier verification, integration workflows

Example Query:

{% code title="Example" %}

```sql
SELECT 
    datasource_name,
    data_format,
    last_scan,
    attribute_count,
    polymorphic_attribute_count,
    product_tier_attribute_metadata_management,
    product_tier_sql_code_generation
FROM core.vw_datasources
WHERE datasource_status = 'active'
ORDER BY datasource_name;
```

{% endcode %}

***

## VW\_DATASOURCE\_SCANS

Historical scan execution records with performance metrics.

**Contents:** Scan identification, timing (begin, end, duration), status, record counts, performance metrics (records per minute), configuration details (WHERE clause, ORDER BY), warehouse information, thread/batch details

**Use cases:** Scan history review, performance analysis, troubleshooting, monitoring completion

Example Query:

{% code title="Example" %}

```sql
SELECT 
    datasource_name,
    configuration_name,
    scan_datetime_begin,
    scan_duration_minutes,
    records_processed,
    records_processed_per_minute,
    scan_status
FROM core.vw_datasource_scans
WHERE datasource_id = 'your-datasource-id'
ORDER BY scan_datetime_begin DESC;
```

{% endcode %}

***

## VW\_DATASOURCE\_SCANS\_IN\_PROCESS

Real-time monitoring of currently executing scans with progress estimates.

**Contents:** Active scan identification, progress tracking (records processed, estimated remaining), time estimates (duration, time remaining, percentage complete), performance metrics, thread configuration, batch status, warehouse information

**Use cases:** Monitoring active scans, progress tracking, performance optimization, resource utilization

Example Query:

{% code title="Example" %}

```sql
SELECT 
    datasource_name,
    configuration_name,
    scan_status,
    percentage_complete,
    estimated_records_processed,
    estimated_records_remaining,
    process_time_remaining_in_minutes
FROM core.vw_datasource_scans_in_process
ORDER BY scan_datetime_begin DESC;
```

{% endcode %}

***

## VW\_DATASOURCE\_SCAN\_CONFIGURATIONS

All scan configuration settings for data sources.

**Contents:** Configuration identification, record limits/filtering (`SCAN_RECORD_LIMIT`, `SCAN_WHERE_CLAUSE`, `SCAN_ORDER_BY`), scheduling (`MONITOR_ENABLED`, `MONITOR_CRON_SCHEDULE`, `MONITOR_CRON_TIMEZONE`), vertical scale settings (`PROCEDURE_INSTANCE_COUNT`, `PROCEDURE_INSTANCE_ROW_COUNT`, thread count), warehouse assignment, `CODE_GENERATE_ON_VERSION_CHANGE`, `ATTRIBUTE_CREATE_TYPE`

**Use cases:** Configuration review, comparison, integration workflows, audit

Example Query:

{% code title="Example" %}

```sql
SELECT 
    datasource_name,
    configuration_name,
    enable_schedule,
    cron_schedule,
    number_of_procedure_calls,
    thread_count,
    warehouse_name
FROM core.vw_datasource_scan_configurations
WHERE datasource_id = 'your-datasource-id';
```

{% endcode %}

***

## VW\_DATASOURCE\_SCAN\_ERRORS

Error records from scan operations for diagnostics and troubleshooting.

**Contents:** Error identification, scan/batch information, error messages, timestamps, status

**Use cases:** Error diagnostics, troubleshooting scan failures, quality monitoring

Example Query:

{% code title="Example" %}

```sql
SELECT 
    datasource_name,
    configuration_name,
    error_message,
    scan_datetime_begin
FROM core.vw_datasource_scan_errors
WHERE datasource_id = 'your-datasource-id'
ORDER BY scan_datetime_begin DESC
LIMIT 100;
```

{% endcode %}

***

## VW\_DATASOURCE\_SCAN\_PROCEDURE\_CALLS

Detailed procedure call information for scans using multiple procedure calls.

**Contents:** Procedure call identification (procedure number, scan ID), timing (start, end, duration), records processed per call, performance metrics (records per minute per procedure), thread/batch information, version information

**Use cases:** Performance analysis for multi-call scans, procedure call optimization, timeout management

Example Query:

{% code title="Example" %}

```sql
SELECT 
    datasource_name,
    procedure_number,
    procedure_records_processed,
    procedure_records_processed_per_minute,
    procedure_start_time,
    procedure_end_time
FROM core.vw_datasource_scan_procedure_calls
WHERE datasource_scan_id = 'your-scan-id'
ORDER BY procedure_number;
```

{% endcode %}

***

## VW\_DATASOURCE\_SCAN\_COMPUTE\_RESOURCE\_USE

Active scan compute resource utilization for warehouse management.

**Contents:** Scan/data source identification, warehouse information, scan status/progress, record counts

**Use cases:** Warehouse utilization monitoring, resource conflict detection, capacity planning

**Note:** This view is not explicitly defined in the codebase; may be referenced but not created.

Example Query:

{% code title="Example" %}

```sql
SELECT 
    compute_resource_name,
    datasource_name,
    scan_status,
    records_processed
FROM core.vw_datasource_scan_compute_resource_use
WHERE scan_status != 'Completed' AND scan_status != 'Failed';
```

{% endcode %}

***

## VW\_DATASOURCE\_BILLING\_EVENTS

Billing event history for product tier upgrades and scan operations.

**Contents:** Event identification (type, description, timestamp), data source information (current and historical names), product tier information, billing details (month, year, pricing tier, price, charge), attribute quantity, version information, scan association

**Note:** Created when product tier is upgraded for a data source or a scan is performed in a given month.

**Use cases:** Billing review/audit, cost analysis, product tier history, financial reporting

Example Query:

{% code title="Example" %}

```sql
SELECT 
    current_datasource_name,
    product_tier_name,
    event_type,
    billing_month,
    billing_year,
    price,
    charge
FROM core.vw_datasource_billing_events
WHERE billing_year = 2024
ORDER BY billing_month DESC, created_datetime DESC;
```

{% endcode %}

***

## VW\_DATASOURCE\_PRODUCT\_TIER\_AUDIT\_LOG

Historical record of product tier changes for data sources.

**Contents:** Product tier change history, timestamps, user information, data source information (current and historical), source connection details at time of change, record status

**Note:** Created when product tier changes for a data source.

**Use cases:** Product tier change audit trail, historical configuration review, compliance/governance, change tracking

Example Query:

{% code title="Example" %}

```sql
SELECT 
    current_datasource_name,
    product_tier_name,
    date_added,
    added_by_user,
    datasource_name_at_time_of_change
FROM core.vw_datasource_product_tier_audit_log
WHERE datasource_id = 'your-datasource-id'
ORDER BY date_added DESC;
```

{% endcode %}


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.datapancake.com/core-concepts/views/schema-summary-views.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.