How to Modify the Schema
1. Navigate to the Data Sources page

2. Select the data source

3. Scroll down to the Schema Transformation section
Schema transformations are used to modify the source schema during the materialization process.

4. Click the + symbol in the bottom row to add a new schema transformation
To delete a row move your mouse to the leftmost column in the table to reveal a checkbox, check the box, and press the delete key.

5. Add the required schema transformation properties
For this guide we will add four transforms. See the table below the screenshots for exact values




Name
Transformation Type
Search Attribute Path
Search Expression
Replace Expression
String List Type
String Delimiter Value
transform_1
consolidate schema
Y|Cre|Shipment|
|\d+
transform_2
transform string to array
special_tags_pipe
primitive
|
transform_3
transform string to array
batch_tags_pipe
primitive
|
transform_4
transform objects to array
operation_logs
^op_[a-z]+-[0-9a-fA-F]{8}-[0-9a-fA-F]{4}-[1-5][0-9a-fA-F]{3}-[89abAB][0-9a-fA-F]{3}-[0-9a-fA-F]{12}$
codeId
6. Save the Schema Transformations

7. Ensure the transformations/consolidations updated successfully

Last updated
Was this helpful?