Query Builder Metadata

Overview

Query Builder includes a set of metadata that are available to add as columns to the any dataset table. They are added when you select columns in the Query Builder.

Metadata Fields

Nine metadata fields are available. These include the Osmos internal ID, date create, date modified, user ID, dataflow ID, job ID, uploader ID, raw source data JSON and write index.

Field Details

• Osmos Internal ID: A unique identifier generated for each row in the table. Randomly generated the first time the row is inserted. Will not change in the case of upserts or edits.

• Date Created: A timestamp of when the row was first inserted into the table. Stays the same through the life of that row.

• Date Modified: A timestamp of the last time that any data in the row was edited, upserted, or changed in any way. Will be updated in the case of upserts even if no data actually changes in the row.

• User ID: The internal ID of the user that initiated the insert/upload/job/edit/etc. updated the row to have its most recent value, or that created the row.

• Dataflow ID: The ID of the dataflow which updated or inserted the row. If data is uploaded via Osmos Uploader, this value will be equivalent to Uploader ID. For pipelines this will represent Pipeline ID. Will be updated in the case of upserts even if no data actually changes in the row.

• Job ID: The ID of the job which created or updated the row.

• Uploader ID: The ID of the Uploader which created or updated the row.

• Raw Source Data JSON: A JSON object containing the full data from the source side that was used to map data to this output, if this row was created or updated via an uploader or pipeline. The JSON is returned as a string.

• Write Index: Every time data is inserted, upserted, or edited in a dataset table, a unique monotonically increasing write index is associated with it. For each row, write index will be set to the write index of the insert/upsert/update operation that set the most recent version of data in this row. This will be updated in the case of upserts even if no data in the row actually changes.