v0.3.9

Changes

✨ New Features

• [FEAT]: sql IN operator @universalmind303 (#3086)
• [FEAT] Enable explode for swordfish @colin-ho (#3077)
• [FEAT]: add sql DISTINCT @universalmind303 (#3087)
• [FEAT] Enable concat for swordfish @colin-ho (#2976)
• [FEAT] Enable unpivot for swordfish @colin-ho (#3078)
• [FEAT] Outer joins for native executor @colin-ho (#2860)
• [FEAT] Enable pivot for swordfish @colin-ho (#3081)
• [FEAT] Enable sample for swordfish @colin-ho (#3079)
• [FEAT] Add stateful actor context and set CUDA_VISIBLE_DEVICES @kevinzwang (#3002)
• [FEAT]: sql tbl alias, and compount ident for joins @universalmind303 (#3066)
• [FEAT]: sql between @universalmind303 (#3062)
• [FEAT]: Interval dtype @universalmind303 (#3018)
• [FEAT] Enable to_json_string for physical plan @colin-ho (#3023)
• [FEAT]: Daft support for Azure storage for Unity Catalog daft.read_deltalake @anilmenon14 (#3025)
• [FEAT] Iceberg MOR for streaming parquet @colin-ho (#2975)
• [FEAT] Include file paths as column from read_parquet/csv/json @colin-ho (#2953)

🚀 Performance Improvements

• [PERF] Remove stateful actor child materialization limit @kevinzwang (#3099)

👾 Bug Fixes

• [BUG] Bump up max_header_size @raunakab (#3068)
• [BUG] Autodetect AWS region during deltalake scan @kevinzwang (#3104)
• [BUG] Add over clause in read_sql percentile reads @colin-ho (#3094)
• [BUG] Disable Linux SSL CERT override @samster25 (#3098)
• [BUG] Fix into_partitions to use a more naive approach without materialization @jaychia (#3080)
• [BUG] Fix actor pool initialization in ray client mode @kevinzwang (#3028)
• [BUG]: joins with duplicate column names and qualified table expansion @universalmind303 (#3074)
• [BUG]: sql functions case sensitivit @universalmind303 (#3063)
• [BUG] Fix write_deltalake add action file path prefix @kevinzwang (#3053)
• [BUG] Fix intersection checking when unioning schemas @desmondcheongzx (#3039)
• [BUG] Sampling without replacement not working @colin-ho (#3035)

🧰 Maintenance

• [CHORE]: replace the .venv value with global variable VENV @mohamedrezk122 (#3084)
• [CHORE] Enable lancedb reads for native executor @colin-ho (#2925)
• [CHORE] Auto attach LLDB debugger to python #2940 @sagiahrac (#3020)
• [CHORE] Rename config.yaml to config.yml @samster25 (#3045)
• [CHORE] add config.yaml for issues @samster25 (#3044)
• [CHORE] validation on dropdown @samster25 (#3043)
• [CHORE] preserve quotes in yaml @samster25 (#3042)
• [CHORE] Checkbox for contribution @samster25 (#3041)
• [CHORE] update feature request @samster25 (#3040)