Releases: sdf-labs/sdf-cli
Releases · sdf-labs/sdf-cli
v0.4.1
What's Changed
- Impact Analysis V1 MVP by @venkaa28 in sdf-labs/sdf#3273
- Added impact analysis toggle to workspace settings by @rpechuk in sdf-labs/sdf#3291
- Impact Analysis Updates by @venkaa28 in sdf-labs/sdf#3318
- [DRAFT] Harry/handle IA failure cases by @xuliangs in sdf-labs/sdf#3312
- sqlgen: Enumerating SQL select (literal, ident) pairs by @gliga in sdf-labs/sdf#3384
- Zhong/databricks by @wizardxz in sdf-labs/sdf#3397
- Handle null columns in Snowflake connector's re-batch by @milevin in sdf-labs/sdf#3403
- create a workspace in create_credential if there isn't one by @xuliangs in sdf-labs/sdf#3402
- Escape comments during materialization by @findepi in sdf-labs/sdf#3399
- doc: Typo fixes in cli help messages by @gliga in sdf-labs/sdf#3408
- Fixes to workspace status polling by @rpechuk in sdf-labs/sdf#3359
- Use snowflake dialect for sqllogictest_snowflake_remote local execution by @findepi in sdf-labs/sdf#3400
- Changed table component to be aligned with Figma by @rpechuk in sdf-labs/sdf#3360
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3398
- Removed unnecessary AWS creds input on deploy docs job by @eliasdefaria in sdf-labs/sdf#3395
- Remove duplicate snowflake count_if function by @findepi in sdf-labs/sdf#3414
- Test SLT with Snowflake data types and other Snowflake SLT cleanups by @findepi in sdf-labs/sdf#3413
- Fixed documentation generation for yml schema where descriptions have new lines. Added creds env var section by @eliasdefaria in sdf-labs/sdf#3424
- Scale Production Nodes by @akbog in sdf-labs/sdf#3436
- Implement Worker Queue lock on tasks by @venkaa28 in sdf-labs/sdf#3416
- Bump lexical-core from 0.8.5 to 1.0.0 by @dependabot in sdf-labs/sdf#3386
- Bump serve-static and express in /platform/docs by @dependabot in sdf-labs/sdf#3370
- Bump body-parser and express in /platform/docs by @dependabot in sdf-labs/sdf#3343
- Bump path-to-regexp and express in /platform/docs by @dependabot in sdf-labs/sdf#3320
- Bump send and express in /platform/docs by @dependabot in sdf-labs/sdf#3327
- Impact Analysis Updates by @venkaa28 in sdf-labs/sdf#3387
- Make make_scalar_function() result candidate for inlining by @findepi in sdf-labs/sdf#3390
- Updated xtask init-creds to not depend on sdf-cli crate for more efficient integration testing by @eliasdefaria in sdf-labs/sdf#3438
- Fix Redshift metadata integration's queries by @findepi in sdf-labs/sdf#3440
- Specify local crates' path once by @findepi in sdf-labs/sdf#3389
- Rename encryption key constant to prevent misuse by @findepi in sdf-labs/sdf#3277
- Schedule one branch per worker schema migration by @venkaa28 in sdf-labs/sdf#3409
- fixed push workspace lock and fixed connect workspace path parsing by @venkaa28 in sdf-labs/sdf#3446
- Remove json file writing in test/check execution by @findepi in sdf-labs/sdf#3441
- Fix casing issues in lineage graph by @akbog in sdf-labs/sdf#3447
- Removed ~50 duplicates from the list of snowflake functions. by @vgapeyev in sdf-labs/sdf#3450
- Refine error output by @sadboy in sdf-labs/sdf#3429
- Finished table fixes by @rpechuk in sdf-labs/sdf#3451
- Support
count
in Snowflake by @findepi in sdf-labs/sdf#3442 - Fail SLT on all kinds of failures by @findepi in sdf-labs/sdf#3421
- Easier ad-hoc execution of testing workspace by @findepi in sdf-labs/sdf#3463
- [Linter] Docs prep for release by @shellymat in sdf-labs/sdf#3149
- fmt remove the trailing semicolon by @wizardxz in sdf-labs/sdf#3304
- Macos: commit missing test files by @sadboy in sdf-labs/sdf#3455
- Split sqllogictest_snowflake_remote_and_local into smaller by @findepi in sdf-labs/sdf#3464
- Add
--show-all-errors
command line arg by @sadboy in sdf-labs/sdf#3479 - Retain run/test/check execution error messages by @findepi in sdf-labs/sdf#3467
- fix goldie for test_my_rules_lint by @wizardxz in sdf-labs/sdf#3485
- Update
goldie
dependency to 0.5.0 by @findepi in sdf-labs/sdf#3445 - Easier uncomment to update goldie files by @findepi in sdf-labs/sdf#3473
- Harry/clone using sparse checkout by @xuliangs in sdf-labs/sdf#3388
- Harry/schedule tasks dag by @xuliangs in sdf-labs/sdf#3226
- Harry/fix on conflict error by @xuliangs in sdf-labs/sdf#3490
- Remove the
--no-save
option and re-enable the--save
option forsdf dbt refresh
by @milevin in sdf-labs/sdf#3489 - fix path filtering by @xuliangs in sdf-labs/sdf#3494
- Implement execution support for
EXPLAIN
by @sadboy in sdf-labs/sdf#3493 - Fix unwrap on Ok result in tests by @findepi in sdf-labs/sdf#3505
- Introduce WorkspaceEnv to isolate test execution by @gliga in sdf-labs/sdf#3492
- Harry/sparse checkout fixes by @xuliangs in sdf-labs/sdf#3513
- Fix Snowflake identifier rendering by @sadboy in sdf-labs/sdf#3465
- remove :: in trino and bigquery by @wizardxz in sdf-labs/sdf#3503
- Easier loading of datafusion UDFs by @vgapeyev in sdf-labs/sdf#3491
- reducing workers in staging by @venkaa28 in sdf-labs/sdf#3519
- don't use sparse check if sub_path is root by @xuliangs in sdf-labs/sdf#3518
- Revert "Retain execution error cause" by @findepi in sdf-labs/sdf#3514
- skipping the deploy and test job entirely if no changes to platform by @venkaa28 in sdf-labs/sdf#3521
- fix s3 upload on error result by @xuliangs in sdf-labs/sdf#3520
- updated pr_test console workflow by @venkaa28 in sdf-labs/sdf#3524
- Cached compilation now also detects added SDF and JINJA files by @wolfram-s in sdf-labs/sdf#3511
- Corrected typos and added section on generic tests by @eliasdefaria in sdf-labs/sdf#3525
- Added telemetry to the Cloud app! by @rpechuk in sdf-labs/sdf#3425
- Quick patch to column description issue by @eliasdefaria in sdf-labs/sdf#3533
- temporarily excluding cloud telem by @venkaa28 in sdf-labs/sdf#3532
- Snowflake: TRANSFORM and FILTER by @sadboy in sdf-labs/sdf#3526
- Simplify code a little by @findepi in sdf-labs/sdf#3507
- Fix reading float and scaled decimal values from Snowflake by @findepi in sdf-labs/sdf#3538
- "Presto" to "Trino" cleanup 1 by @findepi in sdf-labs/sdf#3470
- Workspace that shows that SDF tracks changes to Remote but ONLY for sources! by @wolfram-s in sdf-labs/sdf#3529
- tests: Isolate lint tests using WorkspaceEnv by @gliga in sdf-labs/sdf#3528
- Fix 3531: Fixes cache nondeterminsm by using deterministic data structures by @wolfram-s in sdf-labs/sdf#3539
- Temporarily fixes telemetry by excluding broken files by @venkaa28 in sdf-labs/sdf#3543
- Run CLI tests on main after merge by @findepi in sdf-labs/sdf#3471
- Zhong/fix minor issues in lint by @wizardxz in sdf-labs/sdf#3545
- refactor: remove operators from functions.sdf.yml by @wizardxz in sdf-labs/sdf#3423
- github: Enable an option to not run tests while PR is not ready for review by @gliga in sdf-labs/sdf#3544
- fixes for git switch by @xuliangs in sdf-labs/sdf#3550
- tests: Renable cache tests that require the touch command by @gliga in sdf-labs/sdf#3488
- Remote Snowflake division test by @milevin in sdf-labs/sdf#3553
- Support json-path parameter in sdf auth login bigquery by @milevin in sdf-labs/sdf#3552
- Support min, max, sum aggregation functions for Snowflake local execution by @findepi in sdf-labs/sdf#3510
SchemaOverlayTableProvider
: fix schema of scan plan by @sadboy in sdf-labs/sdf#3554- ExternalTableProvider: fix schema handling for partitioned tables by @sadboy in sdf-labs/sdf#3562
- sdf build (part1: local only) by @wolfram-s in sdf-labs/sdf#3176
- Stop double building cli in PR. by @schulte-lukas in sdf-labs/sdf#3565
- Delete. a superflous println (introduced earlier for debugging) by @wolfram-s in sdf-labs/sdf#3568
- fixing posthog integration tabl by @venkaa28 in sdf-labs/sdf#3570
- Separate and isolate lint tests (r...
v0.4.0
What's Changed
- minor: Make cli command text more uniform by @gliga in sdf-labs/sdf#3332
- Introduce remote bigquery tests -- the beginning by @milevin in sdf-labs/sdf#3310
- Zhong/databricks relation gramma by @wizardxz in sdf-labs/sdf#3334
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3333
- BQ Integration Tests: Enabling a few more tests copied from SF by @milevin in sdf-labs/sdf#3336
- Hardening Scheduler to fail more gracefully by @rpechuk in sdf-labs/sdf#3339
- wrapping process_task_instance_event in a tokio event to catch panics by @venkaa28 in sdf-labs/sdf#3342
- reconnect on channel closed lapin error by @xuliangs in sdf-labs/sdf#3341
- add error logs on TaskInstanceFailed by @xuliangs in sdf-labs/sdf#3344
- More BQ integration tests by @milevin in sdf-labs/sdf#3340
- Remove unused
df_comparison
param fromsql_test!
by @findepi in sdf-labs/sdf#3338 - Fix incorrect handling of missing source tables by @milevin in sdf-labs/sdf#3348
- Fix example in inline yaml messages by @findepi in sdf-labs/sdf#3349
- Adde BigQuery Basic Materialization Guide & Added BigQuery starter sample by @eliasdefaria in sdf-labs/sdf#3363
- DBT Project Loader by @akbog in sdf-labs/sdf#3365
- Zhong/support default column alias for bigquery by @wizardxz in sdf-labs/sdf#3371
- Fix sqllogictest idempotency by @findepi in sdf-labs/sdf#3364
- Downgrade Trino local execution support by @findepi in sdf-labs/sdf#3347
- Cater for trailing comment when formatting materialization in sqllogictests by @findepi in sdf-labs/sdf#3361
- Structured scope timing by @findepi in sdf-labs/sdf#3321
- substitution warning on model files by @wizardxz in sdf-labs/sdf#3373
- Bigquery: implement support for LIKE/CLONE by @sadboy in sdf-labs/sdf#3372
- MacOS: explicitly error when
is_tablename_case_sensitive
by @sadboy in sdf-labs/sdf#3382 - Update cargo and nexttest by @wolfram-s in sdf-labs/sdf#3380
- Restructure bigquery aggregation tests for case insensitive platforms by @sadboy in sdf-labs/sdf#3383
- Update Makefile to record the show limit by @milevin in sdf-labs/sdf#3378
- Upgrade to DataFusion 40.0.0 by @vgapeyev in sdf-labs/sdf#3316
- Inline sql-functions repository in crates/sql-functions/ by @findepi in sdf-labs/sdf#3385
- Modified cargo xtask init-creds to allow for manual specification of ci mode by @eliasdefaria in sdf-labs/sdf#3377
Full Changelog: sdf-labs/sdf@v0.3.28...v0.4.0
v0.3.28
What's Changed
- Added slack suggestion on sdf new by @schulte-lukas in sdf-labs/sdf#3271
- fix numeric type binding in bigquery by @wizardxz in sdf-labs/sdf#3289
- Implement table download for BQ by @milevin in sdf-labs/sdf#3278
- Refactoring remote tests to prepare for BQ tests by @milevin in sdf-labs/sdf#3305
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3303
- Error handling: detect duplicate column names in
CREATE TABLE AS
by @sadboy in sdf-labs/sdf#3308 - comment out debug logs from github webhook router by @xuliangs in sdf-labs/sdf#3314
- databricks sql reference syntax by @wizardxz in sdf-labs/sdf#3309
- fulfill a user deletion request by @xuliangs in sdf-labs/sdf#3311
- sqllogictest: Add support for sdf test update using remote snowflake by @gliga in sdf-labs/sdf#3252
- GitV2 Quick Fixes by @rpechuk in sdf-labs/sdf#3298
- Zhong/databricks function call by @wizardxz in sdf-labs/sdf#3319
- Stop printing diagnostics after run/compile error by @findepi in sdf-labs/sdf#3246
- Unify couple test_* methods by @findepi in sdf-labs/sdf#3293
- Fix s3 uri for telemetry upload task by @rpechuk in sdf-labs/sdf#3323
- Harry/changes to run moms_flower_shop in BQ by @xuliangs in sdf-labs/sdf#3317
- Added first bigquery guide, updated integrations pages, and corrected small Snowflake guide mistakes by @eliasdefaria in sdf-labs/sdf#3324
- Quick fix: workaround for broken DatabasePattern by @sadboy in sdf-labs/sdf#3326
- Fix a typo in the debug output for qualified names by @gliga in sdf-labs/sdf#3331
Full Changelog: sdf-labs/sdf@v0.3.27...v0.3.28
v0.3.27
What's Changed
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3297
- Add impact analysis pr comment table by @venkaa28 in sdf-labs/sdf#3284
- Fix Snowflake Json Chunking by @akbog in sdf-labs/sdf#3302
Full Changelog: sdf-labs/sdf@v0.3.26...v0.3.27
v0.3.26
What's Changed
- Git V2 S3/Logging Updates by @rpechuk in sdf-labs/sdf#3181
- Branch Switching and Updated ToolBar by @venkaa28 in sdf-labs/sdf#3178
- added branch to reports and fixed a few bugs by @venkaa28 in sdf-labs/sdf#3198
- Console env refactor by @venkaa28 in sdf-labs/sdf#3189
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3281
- Schema migration for impact analysis toggle by @rpechuk in sdf-labs/sdf#3286
- Git V2 doc updates by @evabgood in sdf-labs/sdf#3205
- databricks step 2 by @wizardxz in sdf-labs/sdf#3285
- Don't download Snowflake system tables; update account_history schema by @sadboy in sdf-labs/sdf#3287
- Harry/sdf auth login and status bq by @xuliangs in sdf-labs/sdf#3280
- Git v2 by @xuliangs in sdf-labs/sdf#3170
- write to db if commit_hash there is null by @xuliangs in sdf-labs/sdf#3292
- Download test data into right directory by @findepi in sdf-labs/sdf#3282
- updating download-artifact version by @venkaa28 in sdf-labs/sdf#3294
- utility script - users by @venkaa28 in sdf-labs/sdf#3288
- doc: Pass over the test page by @gliga in sdf-labs/sdf#3296
- Adds a new table for CLI call distribution by @schulte-lukas in sdf-labs/sdf#3260
- Fix Snowflake stage scope: case sensitivity by @sadboy in sdf-labs/sdf#3290
Full Changelog: sdf-labs/sdf@v0.3.25...v0.3.26
v0.3.25
What's Changed
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3270
- Identifer: interned strings (aka Make TableName Debuggable Again) by @sadboy in sdf-labs/sdf#3272
- Zhong/databricks by @wizardxz in sdf-labs/sdf#3274
- Remove unused print_multilines_delayed function by @findepi in sdf-labs/sdf#3247
- Update AWS dependencies by @findepi in sdf-labs/sdf#3244
- Fix Snowflake identifier parsing by @sadboy in sdf-labs/sdf#3279
- databricks step-1 by @wizardxz in sdf-labs/sdf#3276
Full Changelog: sdf-labs/sdf@v0.3.24...v0.3.25
v0.3.24
What's Changed
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3184
- fixed the incomplete installation bug by @venkaa28 in sdf-labs/sdf#3188
- Zhong/fmt fix by @wizardxz in sdf-labs/sdf#3186
- adding branches to reports by @venkaa28 in sdf-labs/sdf#3197
- Small bug fixes and QOL changes by @rpechuk in sdf-labs/sdf#3187
- fmt fix by @wizardxz in sdf-labs/sdf#3199
- Additional cache invalidation issues by @venkaa28 in sdf-labs/sdf#3191
- doc: Several doc corrections and more uniform by @gliga in sdf-labs/sdf#3177
- newline in comments by @wizardxz in sdf-labs/sdf#3206
- Zhong/pre processor repro by @wizardxz in sdf-labs/sdf#3209
- Fix Env Var Flag in CLI by @venkaa28 in sdf-labs/sdf#3196
- pysdf: A demo example of an example SDF's Python API by @gliga in sdf-labs/sdf#3201
- Granted Piotr AWS access by @eliasdefaria in sdf-labs/sdf#3218
- Semantic identifier and table names by @sadboy in sdf-labs/sdf#3208
- [TableName followup] Re-enable disabled tests by @sadboy in sdf-labs/sdf#3223
- Add Docker image base for SDF CLI by @akbog in sdf-labs/sdf#3183
- TableName cleanup: delete deadcode; add some docs by @sadboy in sdf-labs/sdf#3225
- Fix grammar typo and keyword generator by @sadboy in sdf-labs/sdf#3231
- dialect specific materialize.jinja by @wizardxz in sdf-labs/sdf#3230
- Upgrade to DataFusion 39.0.0 by @vgapeyev in sdf-labs/sdf#3214
- remove .keyword by @wizardxz in sdf-labs/sdf#3236
- fmt a specific file by @wizardxz in sdf-labs/sdf#3215
- no dangling comma warning for bigquery by @wizardxz in sdf-labs/sdf#3241
- Zhong/linter defaults parameter by @wizardxz in sdf-labs/sdf#3232
- Update stale_issues.yml bot by @evabgood in sdf-labs/sdf#3237
- Made docs updates based on feedback from open source by @eliasdefaria in sdf-labs/sdf#3240
- Implement configurable TableName case sensitivity by @sadboy in sdf-labs/sdf#3243
- Updated documentation based on feedback from the community by @eliasdefaria in sdf-labs/sdf#3251
- Zhong/bigquery concat by @wizardxz in sdf-labs/sdf#3250
- Remove case-only difference filenames by @sadboy in sdf-labs/sdf#3245
- Zhong/spark init version by @wizardxz in sdf-labs/sdf#3248
- Robustify parse_fqn; fix Snowflake backtick'd identifiers by @sadboy in sdf-labs/sdf#3253
- Provider logic to support BQ by @milevin in sdf-labs/sdf#3035
- fix credentials loading for push by @xuliangs in sdf-labs/sdf#3256
- Address code warning for iteration over Option by @findepi in sdf-labs/sdf#3249
- Improve cargo test stanza in readme by @findepi in sdf-labs/sdf#3220
- Update certain dependencies by @findepi in sdf-labs/sdf#3254
- fix snowflake connect by by @wizardxz in sdf-labs/sdf#3262
- Fix sources and cross-schema imports by @milevin in sdf-labs/sdf#3259
- Minor refactoring -- moving all bigquery craft into a utils module by @milevin in sdf-labs/sdf#3263
New Contributors
- @findepi made their first contribution in sdf-labs/sdf#3249
Full Changelog: sdf-labs/sdf@v0.3.23...v0.3.24
v0.3.23
What's Changed
- fix lint fix by @wizardxz in sdf-labs/sdf#3158
- remove dollar in disallow list by @wizardxz in sdf-labs/sdf#3173
- Zhong/fmt by @wizardxz in sdf-labs/sdf#3156
- Zhong/sdf fmt by @wizardxz in sdf-labs/sdf#3101
- Remove --log-form, always nest, introduce debug-pretty by @akbog in sdf-labs/sdf#3167
- better error message for arrow error by @wizardxz in sdf-labs/sdf#2616
- Revert "better error message for arrow error" by @sadboy in sdf-labs/sdf#3175
- sdf fmt fixes by @wizardxz in sdf-labs/sdf#3174
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3165
- Ensure Cached Output Logs are in Dependency Order by @akbog in sdf-labs/sdf#3182
- Delete Developer Node & Disable Developer Pod in Cluster by @akbog in sdf-labs/sdf#3166
- Elias/docs improvements by @eliasdefaria in sdf-labs/sdf#3172
Full Changelog: sdf-labs/sdf@v0.3.22...v0.3.23
v0.3.22
What's Changed
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3148
- Harry/git v2 prep: migrate from
latest
tolatest/[branch]
by @xuliangs in sdf-labs/sdf#3105 - [Linter] Fix --help comment by @shellymat in sdf-labs/sdf#3104
- Zhong/lint fix by @wizardxz in sdf-labs/sdf#3147
- doc: Minor cleanup: rm a duplicate step, formatting, and a few test commands by @gliga in sdf-labs/sdf#3137
- Update Worker to Retrieve Git Token by @venkaa28 in sdf-labs/sdf#3127
- Fixes from onboarding by @rpechuk in sdf-labs/sdf#3145
- adding demo workspaces for prod console demos by @venkaa28 in sdf-labs/sdf#3153
- Fix syncronous table cache writes by @akbog in sdf-labs/sdf#3155
- Fix type: macros not ingesting jinja files by @akbog in sdf-labs/sdf#3154
- Fixes Report issue with missing seeds in include paths by @akbog in sdf-labs/sdf#3164
- Fix write_table_df by @sadboy in sdf-labs/sdf#3162
- fix: Do not duplicate equal strings when merging by @gliga in sdf-labs/sdf#3163
Full Changelog: sdf-labs/sdf@v0.3.21...v0.3.22
v0.3.21
What's Changed
- Updating Version by @sdf-labs-cicd-app in sdf-labs/sdf#3129
- Environment Variable Patch by @venkaa28 in sdf-labs/sdf#3112
- Harry/remove unncessary required attributes for user sign up by @xuliangs in sdf-labs/sdf#3142
- move case-function to syntax rule by @wizardxz in sdf-labs/sdf#3130
- github: Authenticate and fetch the repo before checking code changes during daily test runs by @gliga in sdf-labs/sdf#3141
- Updated preprocessor, obsolete sql-vars by @wolfram-s in sdf-labs/sdf#3135
- support lateral variable lint by @wizardxz in sdf-labs/sdf#3131
- Cleanup Logging & Add Additional Safe Guards by @akbog in sdf-labs/sdf#3132
New Contributors
- @gliga made their first contribution in sdf-labs/sdf#3141
Full Changelog: sdf-labs/sdf@v0.3.20...v0.3.21