Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add historical retrieval for BigQuery and Parquet #1389

Merged
merged 29 commits into from
Mar 16, 2021
Merged

Add historical retrieval for BigQuery and Parquet #1389

merged 29 commits into from
Mar 16, 2021

Commits on Mar 16, 2021

  1. Add ParquetSource 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    dc4906b View commit details
    Browse the repository at this point in the history

  2. Add Parquet source, TTL validation, and fix BQ source conditional 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    2c465fe View commit details
    Browse the repository at this point in the history

  3. Add partial Parquet Historical retrieval 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    5b1c584 View commit details
    Browse the repository at this point in the history

  4. Reformat and lint 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    16b716d View commit details
    Browse the repository at this point in the history

  5. Remove feature_views_to_query from get_historical_features 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    b93cba5 View commit details
    Browse the repository at this point in the history

  6. Clean up get_hist_features test 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    20576b5 View commit details
    Browse the repository at this point in the history

  7. Added point-in-time query for BigQueryOfflineStore 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    9a5bc12 View commit details
    Browse the repository at this point in the history

  8. Fix ParquetSource tests 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    785af1f View commit details
    Browse the repository at this point in the history

  9. Clean up and reactor offline_store.py functions 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    940c2ae View commit details
    Browse the repository at this point in the history

  10. Relax Python dependencies and fix broken TTL 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    fe3e9c0 View commit details
    Browse the repository at this point in the history

  11. Fix time zones in point-in-time join 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    b2f30e5 View commit details
    Browse the repository at this point in the history

  12. Reformat using black 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    8d5c650 View commit details
    Browse the repository at this point in the history

  13. Move get_historical_features into feature_store and get mypy to pass 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    c6da3cc View commit details
    Browse the repository at this point in the history

  14. Replace ParquetSource with FileSource 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    9f8d0d9 View commit details
    Browse the repository at this point in the history

  15. Fix feature request building 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    cad7cb5 View commit details
    Browse the repository at this point in the history

  16. Clean up context building code 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    00a48da View commit details
    Browse the repository at this point in the history

  17. Remove RegistryState Class 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    c64e99f View commit details
    Browse the repository at this point in the history

  18. Fix tests writing to disk 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    b9c1e90 View commit details
    Browse the repository at this point in the history

  19. Skip BigQuery test during unit tests 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    93ad2d2 View commit details
    Browse the repository at this point in the history

  20. Revert documentation changes 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    dfc811b View commit details
    Browse the repository at this point in the history

  21. Add documentation for historical retrieval and apply 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    513bcff View commit details
    Browse the repository at this point in the history

  22. Add support for loading entity dataframes 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    3aae713 View commit details
    Browse the repository at this point in the history

  23. Fix typo in query context 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    aba08e1 View commit details
    Browse the repository at this point in the history

  24. Remove hardcoding of created timestamp 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    354c17e View commit details
    Browse the repository at this point in the history

  25. Set created timestamp column in BigQuery test 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    0240ef1 View commit details
    Browse the repository at this point in the history

  26. Revert broken documentation and formatting 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    9cd335d View commit details
    Browse the repository at this point in the history

  27. Set context query to be immutable 

    Co-authored-by: Oleg Avdeev <[email protected]>
Signed-off-by: Willem Pienaar <[email protected]>
    @woop @oavdeev
    woop and oavdeev committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    82595f8 View commit details
    Browse the repository at this point in the history

  28. Add comments based on PR review 

    Signed-off-by: Willem Pienaar <[email protected]>
    @woop
    woop committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    2468261 View commit details
    Browse the repository at this point in the history

  29. Clarify TODO comment for entity dataframe time ranges 

    Co-authored-by: Oleg Avdeev <[email protected]>
Signed-off-by: Willem Pienaar <[email protected]>
    @woop @oavdeev
    woop and oavdeev committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    83f173c View commit details
    Browse the repository at this point in the history