You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When loading to delta tables, it is helpful to take advantage of data partitions for better query performance.
For snowplow data, an appropriate partitioning column is date of the collector timestamp. It is relatively low cardinality, and collector_tstamp is a field that appears in many analytic queries, including Snowplow's standard data models. To make this column available for partitioning, we need to explicitly add it to the COPY INTO statement.
The text was updated successfully, but these errors were encountered:
When loading to delta tables, it is helpful to take advantage of data partitions for better query performance.
For snowplow data, an appropriate partitioning column is date of the collector timestamp. It is relatively low cardinality, and collector_tstamp is a field that appears in many analytic queries, including Snowplow's standard data models. To make this column available for partitioning, we need to explicitly add it to the
COPY INTO
statement.The text was updated successfully, but these errors were encountered: