Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update tensorflow-datasets requirement from <4.5.0,>=1.3.0 to >=1.3.0,<4.6.0 #304

Merged

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Jan 27, 2022

Updates the requirements on tensorflow-datasets to permit the latest version.

Release notes

Sourced from tensorflow-datasets's releases.

v4.5.0

This is the last version of TFDS supporting 3.6. Future version will use 3.7

  • Better split API:

    • Splits can be selected using shards: split='train[3shard]'
    • Underscore supported in numbers for better readability: split='train[:500_000]'
    • Select the union of all splits with split='all'
    • tfds.even_splits is more precise and flexible:
      • Return splits exactly of the same size when passed tfds.even_splits('train', n=3, drop_remainder=True)
      • Works on subsplits tfds.even_splits('train[:75%]', n=3) or even nested
      • Can be composed with other splits: tfds.even_splits('train', n=3)[0] + 'test'
  • FeatureConnectors:

    • Faster dataset generation (using tfrecords)
    • Features now have serialize_example / deserialize_example methods to encode/decode example to proto: example_bytes = features.serialize_example(example_data)
    • Audio now supports encoding='zlib' for better compression
    • Features specs exposed in proto for better compatibility with other languages
  • Better testing:

    • Mock dataset now supports nested datasets
    • Customize the number of sub examples
  • Documentation update:

  • RLDS:

    • Nested datasets features are supported
    • New datasets: Robomimic, D4RL Ant Maze, RLU Real World RL, and RLU Atari with ordered episodes
  • Misc:

    • Create beam pipeline using TFDS as input with tfds.beam.ReadFromTFDS
    • Support setting the file formats in tfds build --file_format=tfrecord
    • Typing annotations exposed in tfds.typing
    • tfds.ReadConfig has a new assert_cardinality=False to disable cardinality
    • Add a tfds.display_progress_bar(True) for functional control
    • Support for huge number of shards (>99999)
    • DatasetInfo exposes .release_notes

And of course, new datasets, bug fixes,...

Thank you to all our contributors for improving TFDS!

Commits

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [tensorflow-datasets](https://github.com/tensorflow/datasets) to permit the latest version.
- [Release notes](https://github.com/tensorflow/datasets/releases)
- [Changelog](https://github.com/tensorflow/datasets/blob/master/docs/release_notes.md)
- [Commits](tensorflow/datasets@v1.3.0...v4.5.0)

---
updated-dependencies:
- dependency-name: tensorflow-datasets
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Jan 27, 2022
@lgeiger lgeiger merged commit 42f8348 into main Jan 27, 2022
@lgeiger lgeiger deleted the dependabot/pip/tensorflow-datasets-gte-1.3.0-and-lt-4.6.0 branch January 27, 2022 10:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file python Pull requests that update Python code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant