Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT] Streaming physical writes for native executor #2992

Merged
merged 18 commits into from
Oct 31, 2024

add unit tests for batch and file writers

b67499e
Select commit
Loading
Failed to load commit list.
Merged

[FEAT] Streaming physical writes for native executor #2992

add unit tests for batch and file writers
b67499e
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Oct 31, 2024 in 1s

87.94% of diff hit (target 78.87%)

View this Pull Request on Codecov

87.94% of diff hit (target 78.87%)

Annotations

Check warning on line 3 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L1-L3

Added lines #L1 - L3 were not covered by tests

Check warning on line 7 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L5-L7

Added lines #L5 - L7 were not covered by tests

Check warning on line 14 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L12-L14

Added lines #L12 - L14 were not covered by tests

Check warning on line 18 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L18

Added line #L18 was not covered by tests

Check warning on line 22 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L21-L22

Added lines #L21 - L22 were not covered by tests

Check warning on line 35 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L32-L35

Added lines #L32 - L35 were not covered by tests

Check warning on line 40 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L37-L40

Added lines #L37 - L40 were not covered by tests

Check warning on line 44 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L44

Added line #L44 was not covered by tests

Check warning on line 46 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L46

Added line #L46 was not covered by tests

Check warning on line 50 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L48-L50

Added lines #L48 - L50 were not covered by tests

Check warning on line 52 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L52

Added line #L52 was not covered by tests

Check warning on line 55 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L54-L55

Added lines #L54 - L55 were not covered by tests

Check warning on line 61 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L61

Added line #L61 was not covered by tests

Check warning on line 64 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L63-L64

Added lines #L63 - L64 were not covered by tests

Check warning on line 70 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L70

Added line #L70 was not covered by tests

Check warning on line 74 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L73-L74

Added lines #L73 - L74 were not covered by tests

Check warning on line 82 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L82

Added line #L82 was not covered by tests

Check warning on line 91 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L90-L91

Added lines #L90 - L91 were not covered by tests

Check warning on line 94 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L93-L94

Added lines #L93 - L94 were not covered by tests

Check warning on line 106 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L102-L106

Added lines #L102 - L106 were not covered by tests

Check warning on line 110 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L108-L110

Added lines #L108 - L110 were not covered by tests

Check warning on line 117 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L112-L117

Added lines #L112 - L117 were not covered by tests

Check warning on line 121 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L120-L121

Added lines #L120 - L121 were not covered by tests

Check warning on line 128 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L128

Added line #L128 was not covered by tests

Check warning on line 136 in daft/io/writer.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

daft/io/writer.py#L135-L136

Added lines #L135 - L136 were not covered by tests