How to Modify the Schema

1. Navigate to the Data Sources page

2. Select the data source

3. Scroll down to the Schema Transformation section

Schema transformations are used to modify the source schema during the materialization process.

4. Click the + symbol in the bottom row to add a new schema transformation

To delete a row move your mouse to the leftmost column in the table to reveal a checkbox, check the box, and press the delete key.

5. Add the required schema transformation properties

For this guide we will add four transforms. See the table below the screenshots for exact values

Name
Transformation Type
Search Attribute Path
Search Expression
Replace Expression
String List Type
String Delimiter Value

transform_1

consolidate schema

Y|Cre|Shipment|

|\d+

transform_2

transform string to array

special_tags_pipe

primitive

|

transform_3

transform string to array

batch_tags_pipe

primitive

|

transform_4

transform objects to array

operation_logs

^op_[a-z]+-[0-9a-fA-F]{8}-[0-9a-fA-F]{4}-[1-5][0-9a-fA-F]{3}-[89abAB][0-9a-fA-F]{3}-[0-9a-fA-F]{12}$

codeId

6. Save the Schema Transformations

7. Ensure the transformations/consolidations updated successfully

Last updated

Was this helpful?