Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AIR] Add experimental read_images #28256

Closed
wants to merge 80 commits into from
Closed

[AIR] Add experimental read_images #28256

wants to merge 80 commits into from

Commits on Sep 2, 2022

  1. Add experimental read_images

    @bveeramani
    bveeramani committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    5e50b46 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2022

  1. Merge branch 'master' into bveeramani/read-images

    @bveeramani
    bveeramani committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    675ca6c View commit details
    Browse the repository at this point in the history

  2. Mark as experimental

    @bveeramani
    bveeramani committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    b8d3974 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2022

  1. Rename PathPartitionScheme as Partitioning

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    4f1d5d7 View commit details
    Browse the repository at this point in the history

  2. Update input_output.rst

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    9afc041 View commit details
    Browse the repository at this point in the history

  3. Update partitioning.py

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    d6b2667 View commit details
    Browse the repository at this point in the history

  4. Update partitioning.py

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    517c390 View commit details
    Browse the repository at this point in the history

  5. Add CSV tests

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    d7a2ae3 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'upstream/master' into bveeramani/partition

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    9416d3c View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'upstream/master' into bveeramani/partition

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    e9a9c5c View commit details
    Browse the repository at this point in the history

  8. Support None field name

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    644878f View commit details
    Browse the repository at this point in the history

  9. Update test_partitioning.py

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    9c65eb9 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'bveeramani/dir-partitioning' into bveeramani/partition

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    7372987 View commit details
    Browse the repository at this point in the history

  11. Merge stuff

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    6980079 View commit details
    Browse the repository at this point in the history

  12. Move code to FileBasedDatasource

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    2253c47 View commit details
    Browse the repository at this point in the history

  13. Delete tmp.csv

    @bveeramani
    bveeramani committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    d34acc9 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. Merge remote-tracking branch 'upstream/master' into bveeramani/partition

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0cfeb58 View commit details
    Browse the repository at this point in the history

  2. Add files

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    38ba956 View commit details
    Browse the repository at this point in the history

  3. Appease lint

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    308bc68 View commit details
    Browse the repository at this point in the history

  4. Update csv_datasource.py

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    a8432e4 View commit details
    Browse the repository at this point in the history

  5. Delete test_csv_partitioning.py

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    b5657a8 View commit details
    Browse the repository at this point in the history

  6. Update file_based_datasource.py

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    f96a498 View commit details
    Browse the repository at this point in the history

  7. Rename

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    44ec745 View commit details
    Browse the repository at this point in the history

  8. Make changes

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    00aac7d View commit details
    Browse the repository at this point in the history

  9. Appease lint

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    a2f2ab0 View commit details
    Browse the repository at this point in the history

  10. Update read_api.py

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    3fd0aac View commit details
    Browse the repository at this point in the history

  11. Add Numpy

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    e0cb06a View commit details
    Browse the repository at this point in the history

  12. Update files

    @bveeramani
    bveeramani committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    4f08b73 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2022

  1. Update read_api.py

    @bveeramani
    bveeramani committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    a839514 View commit details
    Browse the repository at this point in the history

  2. Update files

    @bveeramani
    bveeramani committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    fc087f1 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/master' into bveeramani/read-i… 

    …mages
    @bveeramani
    bveeramani committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    bca3925 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'bveeramani/partition' into bveeramani/read-images

    @bveeramani
    bveeramani committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    5f7ea9f View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2022

  1. Update read_api.py

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    34b016f View commit details
    Browse the repository at this point in the history

  2. Update error messages

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    e4eb840 View commit details
    Browse the repository at this point in the history

  3. Temp

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    3f1c361 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'bveeramani/partition' into bveeramani/read-images

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    9924029 View commit details
    Browse the repository at this point in the history

  5. Update files

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    5d7b7fe View commit details
    Browse the repository at this point in the history

  6. Bug fix and lint

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    e4a2cb9 View commit details
    Browse the repository at this point in the history

  7. Update files

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    0715fc8 View commit details
    Browse the repository at this point in the history

  8. Appease lint and fix install

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    d7fccfa View commit details
    Browse the repository at this point in the history

  9. Merge branch 'bveeramani/partition' into bveeramani/read-images

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    7f88436 View commit details
    Browse the repository at this point in the history

  10. Fix parameter

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    edf1b9f View commit details
    Browse the repository at this point in the history

  11. Update creating-datasets.rst

    @bveeramani
    bveeramani committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    578edc2 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2022

  1. Fix test

    @bveeramani
    bveeramani committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    249bafc View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2022

  1. Address review comments

    @bveeramani
    bveeramani committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    27d9a59 View commit details
    Browse the repository at this point in the history

  2. Update test_dataset_formats.py

    @bveeramani
    bveeramani committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    c993f2d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into bveeramani/partition

    @bveeramani
    bveeramani committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    65dc78f View commit details
    Browse the repository at this point in the history

  4. Update test_dataset_formats.py

    @bveeramani
    bveeramani committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    92d6af5 View commit details
    Browse the repository at this point in the history

  5. Update test_dataset_formats.py

    @bveeramani
    bveeramani committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    8dc0501 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2022

  1. Merge branch 'master' into bveeramani/partition

    @bveeramani
    bveeramani committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    343c995 View commit details
    Browse the repository at this point in the history

  2. Update test_dataset_formats.py

    @bveeramani
    bveeramani committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    29ed734 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2022

  1. Update python/ray/data/datasource/text_datasource.py 

    Co-authored-by: Clark Zinzow <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
    @bveeramani @clarkzinzow
    bveeramani and clarkzinzow authored Sep 28, 2022
    Configuration menu
    Copy the full SHA
    0ef5585 View commit details
    Browse the repository at this point in the history

  2. Update python/ray/data/tests/test_dataset_formats.py 

    Co-authored-by: Clark Zinzow <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
    @bveeramani @clarkzinzow
    bveeramani and clarkzinzow authored Sep 28, 2022
    Configuration menu
    Copy the full SHA
    2fb3451 View commit details
    Browse the repository at this point in the history

  3. Address review comments

    @bveeramani
    bveeramani committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    baf096e View commit details
    Browse the repository at this point in the history

  4. Update test_partitioning.py

    @bveeramani
    bveeramani committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    a3d5729 View commit details
    Browse the repository at this point in the history

  5. Address review comments

    @bveeramani
    bveeramani committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    ef2e79e View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'upstream/master' into bveeramani/partition

    @bveeramani
    bveeramani committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    fbf2bb1 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2022

  1. Merge branch 'master' into bveeramani/read-images

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    01be922 View commit details
    Browse the repository at this point in the history

  2. Update test_dataset_image.py

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    6f6855d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into bveeramani/partition

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    c3cdf7b View commit details
    Browse the repository at this point in the history

  4. Tests

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    5eaa52b View commit details
    Browse the repository at this point in the history

  5. Delete x.npy

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    0604d3a View commit details
    Browse the repository at this point in the history

  6. Appease lint

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    50f99ca View commit details
    Browse the repository at this point in the history

  7. Merge branch 'bveeramani/partition' into bveeramani/read-images

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    b1d9b33 View commit details
    Browse the repository at this point in the history

  8. Delete model

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    2f65750 View commit details
    Browse the repository at this point in the history

  9. Update pytorch_training_e2e.py

    @bveeramani
    bveeramani committed Sep 29, 2022
    Configuration menu
    Copy the full SHA
    2d23510 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2022

  1. Merge branch 'master' into bveeramani/read-images

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    3138d7b View commit details
    Browse the repository at this point in the history

  2. Appease lint

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    2dfd0fd View commit details
    Browse the repository at this point in the history

  3. Minor fixes

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    ad8f81c View commit details
    Browse the repository at this point in the history

  4. Update documentation

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    151309b View commit details
    Browse the repository at this point in the history

  5. Remove references

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    d827ccb View commit details
    Browse the repository at this point in the history

  6. Update creating-datasets.rst

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    5d6af8b View commit details
    Browse the repository at this point in the history

  7. Update read_benchmark.py

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    46f0292 View commit details
    Browse the repository at this point in the history

  8. Minor fixes

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    9c1c277 View commit details
    Browse the repository at this point in the history

  9. Fix CI

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    208089b View commit details
    Browse the repository at this point in the history

  10. Update read_api.py

    @bveeramani
    bveeramani committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    ddd342f View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. Address review comments

    @bveeramani
    bveeramani committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    0dc6dbe View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into bveeramani/read-images

    @bveeramani
    bveeramani committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    0bf9734 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into bveeramani/read-images

    @bveeramani
    bveeramani committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    bdae9f4 View commit details
    Browse the repository at this point in the history

  4. Update test_dataset_image.py

    @bveeramani
    bveeramani committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    4c98cf8 View commit details
    Browse the repository at this point in the history