v0.10.3-p

What's Changed

• tests: Add tests for remote snowflake typeof functions by @gliga in sdf-labs/sdf#4315
• tests: Use xtask test and xtask test -u for testing and updating by @gliga in sdf-labs/sdf#4316
• Enable seeds for BQ remote execution by @milevin in sdf-labs/sdf#4314
• Fail fast if any job fails, cancel all others by @akbog in sdf-labs/sdf#4312
• Fix Dagster Compile Issues + Snapshot Support by @akbog in sdf-labs/sdf#4284
• Fix potential user name collision tests by @akbog in sdf-labs/sdf#4318
• Cleaned Up docker image publishing on relase by @venkaa28 in sdf-labs/sdf#4319

Full Changelog: sdf-labs/sdf@v0.10.2-p...v0.10.3-p

Docker Images

aarch64-unknown-linux-gnu

Image: sdflabs/sdf-aarch64-unknown-linux-gnu:v0.10.3-p
Pull command:

docker pull sdflabs/sdf-aarch64-unknown-linux-gnu:v0.10.3-p

View on DockerHub: Package Link

Digest: sha256:a6fa191cf019ad5692993cfef5d2ae76c740b8a6cb4f2a8941aced9502dda4f6
Pull by digest:

docker pull sdflabs/sdf-aarch64-unknown-linux-gnu@sha256:a6fa191cf019ad5692993cfef5d2ae76c740b8a6cb4f2a8941aced9502dda4f6

x86_64-unknown-linux-musl

Image: sdflabs/sdf-x86_64-unknown-linux-musl:v0.10.3-p
Pull command:

docker pull sdflabs/sdf-x86_64-unknown-linux-musl:v0.10.3-p

View on DockerHub: Package Link

Digest: sha256:78beb02429b5387c091d48644f1ae2ed5d48d4f32acc9b2b31719b6298ac81ee
Pull by digest:

docker pull sdflabs/sdf-x86_64-unknown-linux-musl@sha256:78beb02429b5387c091d48644f1ae2ed5d48d4f32acc9b2b31719b6298ac81ee

v0.10.2-p

What's Changed

• attempt to create docker images on build_sdf_cli step by @venkaa28 in sdf-labs/sdf#4288
• [Port to main] Fixes install script for arm64 platforms returning aarch64 by @sdf-labs-cicd-app in sdf-labs/sdf#4289
• [Port to main] cargo net git fetch with cli by @sdf-labs-cicd-app in sdf-labs/sdf#4287
• Updating Cargo Version by @sdf-labs-cicd-app in sdf-labs/sdf#4297
• Fix failure or stack overflow when overlay has type change by @findepi in sdf-labs/sdf#4300
• Add Bigquery Connector (dbt prereq) & add Bigquery Retries by @akbog in sdf-labs/sdf#4298
• fix nofmt by @wizardxz in sdf-labs/sdf#4296
• tests: Option no-capture for goldie update by @gliga in sdf-labs/sdf#4303
• Fix description propagation, slightly refactor get_table_provider, fix comment materialization test by @milevin in sdf-labs/sdf#4299
• Enhance IO errors reporting to include information what failed by @findepi in sdf-labs/sdf#4223
• log: Match LogSink with TerminalSink (and not with TextFileSink) by @gliga in sdf-labs/sdf#4302
• Commit goldie-update changes by @findepi in sdf-labs/sdf#4306
• Ani/updating docker build by @venkaa28 in sdf-labs/sdf#4307
• updating minor version meaning to smallest semvar value by @venkaa28 in sdf-labs/sdf#4305
• Ani/updating docker build by @venkaa28 in sdf-labs/sdf#4309
• adding docker creds to release workflow by @venkaa28 in sdf-labs/sdf#4311

Full Changelog: sdf-labs/sdf@v0.10.1-p...v0.10.2-p

v0.10.1-p

What's Changed

• bigquery literal formatter by @wizardxz in sdf-labs/sdf#4291
• fix snowflake first_value by @wizardxz in sdf-labs/sdf#4276

Full Changelog: sdf-labs/sdf@v0.10.0-p...v0.10.1-p

v0.10.0-p

What's Changed

• Clean /workspace in test CI build by @findepi in sdf-labs/sdf#4232
• DBT Fixes for Cybersyn by @akbog in sdf-labs/sdf#4225
• Test Snowflake/Trino cross-dialect querying by @findepi in sdf-labs/sdf#4219
• fixed the cdn logs sync workflow sdf cli version to 0.5.7 by @xuliangs in sdf-labs/sdf#4229
• Merge and Delete+Insert incremental strategies + Snapshots by @milevin in sdf-labs/sdf#4217
• Allow unnecessary qualification when compiling in IDE by @findepi in sdf-labs/sdf#4252
• Remove incorrect JOIN to CROSS JOIN conversion by @findepi in sdf-labs/sdf#4249
• dbg: Print the path to the credentials directory that could not be created by @gliga in sdf-labs/sdf#4206
• Updating Cargo Version by @sdf-labs-cicd-app in sdf-labs/sdf#4242
• Fail on unsupported 'run twice' request by @findepi in sdf-labs/sdf#4220
• Support on-schema-change/schema evolution for incremental and snapshot tables in BigQuery by @milevin in sdf-labs/sdf#4258
• Docs Update for Lint Release by @schulte-lukas in sdf-labs/sdf#4210
• Retrofitting New Release Workflows by @venkaa28 in sdf-labs/sdf#4093
• Support of SQL's insert for local and remote execution by @wolfram-s in sdf-labs/sdf#4212
• Roll back Snowflake SUBSTR by @vgapeyev in sdf-labs/sdf#4262
• Re-run sdf make-functions for Snowflake by @vgapeyev in sdf-labs/sdf#4266
• slt: Keep actual value of execution as Result by @gliga in sdf-labs/sdf#4260
• Expression rewriting for adapting DF UDFs to Snowflake by @vgapeyev in sdf-labs/sdf#4230
• Remove "unlogical" variants from SnowflakeLogicalType enum by @findepi in sdf-labs/sdf#4256
• Delete disabled obsolete test describe_code_checks_user_id by @findepi in sdf-labs/sdf#4071
• slt: Report files that are target of a run (user specificed) but are not on include paths by @gliga in sdf-labs/sdf#4259
• Controlling warnings via -w option (first steps) by @wolfram-s in sdf-labs/sdf#4257
• VS Code extension publish actions by @olehpidhi in sdf-labs/sdf#4203
• Added action to run VSCode extension tests by @olehpidhi in sdf-labs/sdf#4168
• [Port to main] Fixed cherry pick to main workflow by @sdf-labs-cicd-app in sdf-labs/sdf#4270
• support create transient table..clone by @wizardxz in sdf-labs/sdf#4267
• Pre-slice dependencies before downloading sources by @milevin in sdf-labs/sdf#4279
• Harry/pen test fixes server HSTS and CSP by @xuliangs in sdf-labs/sdf#4269
• Harry/slack message fix by @xuliangs in sdf-labs/sdf#4286
• Remove left over TODO comments in string.slt by @findepi in sdf-labs/sdf#4290
• add @ as valid remote pattern by @wizardxz in sdf-labs/sdf#4285
• removing sccache that shouldn't be in this workflow by @venkaa28 in sdf-labs/sdf#4292

Full Changelog: sdf-labs/sdf@v0.9.0-p...v0.10.0-p

v0.5.15

What's Changed

• Updating Cargo Version by @sdf-labs-cicd-app in sdf-labs/sdf#4198
• Github Actions: skip check-linked-issue for bot PRs by @sadboy in sdf-labs/sdf#4216
• version two of port-to-main by @venkaa28 in sdf-labs/sdf#4240
• Fixed cherry pick to main workflow by @venkaa28 in sdf-labs/sdf#4265
• cargo net git fetch with cli by @venkaa28 in sdf-labs/sdf#4283
• Tag lfs jobs with lime (don't port to main) by @venkaa28 in sdf-labs/sdf#4282
• Fixes install script for arm64 platforms returning aarch64 by @venkaa28 in sdf-labs/sdf#4241
• updated install scripts so we don't download and reinstall the desired version if its already installed by @venkaa28 in sdf-labs/sdf#4271

Full Changelog: sdf-labs/sdf@v0.5.14...v0.5.15

v0.9.0-p

What's Changed

• Fix doc generation issues due to cybersyn source table deprecation by @eliasdefaria in sdf-labs/sdf#4176
• refactor CodeLocation, add index by @wizardxz in sdf-labs/sdf#4166
• Update bug_report.md to prompt for preview or stable by @eliasdefaria in sdf-labs/sdf#4184
• Table: implement semantic schema comparison by @sadboy in sdf-labs/sdf#4171
• Updating Cargo Version by @sdf-labs-cicd-app in sdf-labs/sdf#4177
• Bigquery Non-determinism Fix Pt. 2 by @akbog in sdf-labs/sdf#4175
• Fix ORDER BY scope: match column names by @sadboy in sdf-labs/sdf#4196
• adding snowflake order by tests by @wizardxz in sdf-labs/sdf#4194
• clean: Remove some dead code by @gliga in sdf-labs/sdf#4170
• slt: Files in the slts directory are slt type by default by @gliga in sdf-labs/sdf#4169
• Handle (expected) schema mismatches when on-schema-change is set by @milevin in sdf-labs/sdf#4179
• Fix Snowflake LIKE not to have implicit escape by @findepi in sdf-labs/sdf#4153
• Downgrade mismatched schema error to warning for non-datatype YML files by @milevin in sdf-labs/sdf#4199
• More DBT Stuff by @akbog in sdf-labs/sdf#4181
• Remove some clippy suppressions and fix code by @findepi in sdf-labs/sdf#4180
• Bigquery: fix integer type formatting and roundtripping by @sadboy in sdf-labs/sdf#4205
• Add Snowflake literal parsing SLT tests by @findepi in sdf-labs/sdf#4150
• Enable rustc lints in sdf-cli by @findepi in sdf-labs/sdf#4135
• Remove unused SLT-related SQL functions by @findepi in sdf-labs/sdf#4178
• Add SnowflakeLogicalType and Move Snowflake can_coerce, can_cast, ... to SnowflakeTyping trait by @findepi in sdf-labs/sdf#4185
• Prepares Workflows for a Virtual-Lime Future by @schulte-lukas in sdf-labs/sdf#4189
• Github Actions: check linked issues on stable PRs (#4172) by @sadboy in sdf-labs/sdf#4201
• Bump cookie, express and socket.io in /platform/docs by @dependabot in sdf-labs/sdf#4197
• Fix deserialize bigquery (optional query_id) by @akbog in sdf-labs/sdf#4208
• Basic incremental table materialization for BQ by @milevin in sdf-labs/sdf#4202
• fix bigquery merge by @wizardxz in sdf-labs/sdf#4213
• Zhong/fix lint casing by @wizardxz in sdf-labs/sdf#4214
• lint fix single file by @wizardxz in sdf-labs/sdf#4215
• Migrated VSC extension to esbuild by @olehpidhi in sdf-labs/sdf#4204
• Changed extension activation to synchronous and silent mode by @olehpidhi in sdf-labs/sdf#4222
• Use same output formatting for run-once and run-twice by @findepi in sdf-labs/sdf#4218
• fix non-determinism warning overload by @wizardxz in sdf-labs/sdf#4226
• fix snowflake lint stage by @wizardxz in sdf-labs/sdf#4224
• Upped dbt threads from xtask generated profiles yml to 24 (max) by @eliasdefaria in sdf-labs/sdf#4209
• Zhong/fmt check by @wizardxz in sdf-labs/sdf#4233
• Support of assembly backup files. by @wolfram-s in sdf-labs/sdf#4228

Full Changelog: sdf-labs/sdf@v0.8.1-p...v0.9.0-p

v0.8.1-p

What's Changed

• DBT Core Context by @akbog in sdf-labs/sdf#4165
• fix: *.parquet excluded from lfs by @olehpidhi in sdf-labs/sdf#4148
• Fix missing remote table error message by @milevin in sdf-labs/sdf#4159

Full Changelog: sdf-labs/sdf@v0.8.0-p...v0.8.1-p

v0.5.14

What's Changed

• Updating Cargo Version by @sdf-labs-cicd-app in sdf-labs/sdf#4163
• Updated doc gen to fix issue with deprecated CyberSyn source in Stable by @eliasdefaria in sdf-labs/sdf#4191
• Github Actions: check linked issues on stable PRs by @sadboy in sdf-labs/sdf#4172

Full Changelog: sdf-labs/sdf@v0.5.13...v0.5.14

v0.8.0-p

What's Changed

• Zhong/fix join using by @wizardxz in sdf-labs/sdf#4112
• Updating Cargo Version by @sdf-labs-cicd-app in sdf-labs/sdf#4108
• Release Docs Updates by @venkaa28 in sdf-labs/sdf#4091
• tests: Add a test for halt with update by @gliga in sdf-labs/sdf#4084
• Support using remote information schema tables as source tables by @milevin in sdf-labs/sdf#4097
• Updating Cargo Version by @sdf-labs-cicd-app in sdf-labs/sdf#4113
• Enable more dbt tests, bug fixes, missing functionality by @akbog in sdf-labs/sdf#4094
• Fix error: SDF1015: Datafusion error: Optimizer rule 'simplify_expressions' failed by @sadboy in sdf-labs/sdf#4115
• Fix running instructions in test files by @findepi in sdf-labs/sdf#4069
• Don't panic in unimplemented aggregate function by @findepi in sdf-labs/sdf#4120
• Support --prefer-local in sdf check by @milevin in sdf-labs/sdf#4116
• Support cargo xtask test --no-capture by @findepi in sdf-labs/sdf#4101
• Fix Cargo.lock by @findepi in sdf-labs/sdf#4123
• Remove git-lfs requirement for snowflake-tpch sources by @schulte-lukas in sdf-labs/sdf#4099
• Enable rustc lints for most crates by @findepi in sdf-labs/sdf#4118
• Update Trino ClickBench, TPCH, TPCDS run tests to current naming convention by @findepi in sdf-labs/sdf#4127
• Run Snowflake remote SLT cross-check on CI and on demand only by @findepi in sdf-labs/sdf#4117
• slt: Support queries with zero rows in result set by @gliga in sdf-labs/sdf#4131
• Fix incorrect ... LIKE '%' by @findepi in sdf-labs/sdf#4124
• slt: Reformat the line number when reporting mismatch in the result by @gliga in sdf-labs/sdf#4136
• Update Platform Request by @venkaa28 in sdf-labs/sdf#4126
• slt: Add support for queries that have expected errors by @gliga in sdf-labs/sdf#4000
• "Presto" to "Trino" cleanup 4 by @findepi in sdf-labs/sdf#4125
• Fix sdf lint to work with classifiers by @milevin in sdf-labs/sdf#4128
• Invalidate cargo cache on stable worker release by @venkaa28 in sdf-labs/sdf#4143
• Added GH Action to build the VS Code extension by @olehpidhi in sdf-labs/sdf#4154
• Zhong/another bigquery massive fix by @wizardxz in sdf-labs/sdf#4144
• Fixed path to extension for GH Action by @olehpidhi in sdf-labs/sdf#4155
• Fix test panic hook regression by @sadboy in sdf-labs/sdf#4056
• Support --prefer-local for lint and fmt by @milevin in sdf-labs/sdf#4157
• Add dbt testing infrastructure (init-creds) + fix flakiness bug in snowflake connector by @akbog in sdf-labs/sdf#4140
• bq linter by @wizardxz in sdf-labs/sdf#4006
• semicolon fix for bq linters by @wizardxz in sdf-labs/sdf#4160
• Fix bigquery test nondeterministic failures by @akbog in sdf-labs/sdf#4161

New Contributors

• @olehpidhi made their first contribution in sdf-labs/sdf#4154

Full Changelog: sdf-labs/sdf@v0.7.1-p...v0.8.0-p

v0.5.12

What's Changed

• Added warehouse specification, improved BQ onboarding docs by @eliasdefaria in sdf-labs/sdf#4046
• Updating Cargo Version by @sdf-labs-cicd-app in sdf-labs/sdf#4088
• Stable Branch Release docs updates by @venkaa28 in sdf-labs/sdf#4092
• pulling install and update changes in off of main and additional workflow patches by @venkaa28 in sdf-labs/sdf#4105

Full Changelog: sdf-labs/sdf@v0.5.11...v0.5.12