Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DuckDB streaming #41

Merged
merged 15 commits into from
Sep 4, 2024
Merged

DuckDB streaming #41

merged 15 commits into from
Sep 4, 2024

Conversation

y-f-u
Copy link
Contributor

@y-f-u y-f-u commented Aug 14, 2024

Adds the ability to stream records from DuckDB.

@y-f-u y-f-u self-assigned this Aug 14, 2024
@phillipleblanc phillipleblanc self-requested a review August 14, 2024 05:50
@y-f-u y-f-u marked this pull request as draft August 15, 2024 00:24
peasee and others added 6 commits September 4, 2024 13:38
* poc: Support interval in SQLite using an AST analyzer

* Refactoring

* u64 -> i64

* fix: Support INTERVAL expressions in SQLite

* docs: Add comment about flattening arguments list

* refactor: Rename SQLiteVisitor to SQLiteIntervalVisitor

* test: Add some tests

---------

Co-authored-by: Phillip LeBlanc <[email protected]>
@phillipleblanc phillipleblanc changed the base branch from main to spiceai September 4, 2024 06:42
@phillipleblanc phillipleblanc marked this pull request as ready for review September 4, 2024 06:42
@phillipleblanc phillipleblanc added the enhancement New feature or request label Sep 4, 2024
@phillipleblanc phillipleblanc changed the title Duckdb streaming DuckDB streaming Sep 4, 2024
@phillipleblanc phillipleblanc merged commit 8a2610d into spiceai Sep 4, 2024
3 checks passed
@phillipleblanc phillipleblanc deleted the duckdb-streaming-wip branch September 4, 2024 06:53
hozan23 pushed a commit to hozan23/datafusion-table-providers that referenced this pull request Sep 19, 2024
* wip

* duckdb streaming

* clippy

* arrow to arrow stream

* error message

* fix: Support `INTERVAL` in SQLite (datafusion-contrib#85)

* poc: Support interval in SQLite using an AST analyzer

* Refactoring

* u64 -> i64

* fix: Support INTERVAL expressions in SQLite

* docs: Add comment about flattening arguments list

* refactor: Rename SQLiteVisitor to SQLiteIntervalVisitor

* test: Add some tests

---------

Co-authored-by: Phillip LeBlanc <[email protected]>

* Use DuckDB streaming

* Fixes

* Fix feature flagging

* Fix lint

* Add spiceai branch to pull_request

---------

Co-authored-by: peasee <[email protected]>
Co-authored-by: Phillip LeBlanc <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants