Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[PERF] Lazily import heavy modules to speed up import times #2826

Merged
merged 41 commits into from
Sep 19, 2024
Merged

[PERF] Lazily import heavy modules to speed up import times #2826

merged 41 commits into from
Sep 19, 2024

Commits on Sep 16, 2024

  1. Defer Register of Super Type

    @samster25 @desmondcheongzx
    samster25 authored and desmondcheongzx committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    55b53a2 View commit details
    Browse the repository at this point in the history

  2. Add lazy import

    @desmondcheongzx
    desmondcheongzx committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    67566e3 View commit details
    Browse the repository at this point in the history

  3. Fix test

    @desmondcheongzx
    desmondcheongzx committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    b5a3900 View commit details
    Browse the repository at this point in the history

  4. Add more lazy imports

    @desmondcheongzx
    desmondcheongzx committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    1a184d9 View commit details
    Browse the repository at this point in the history

  5. Fix import order

    @desmondcheongzx
    desmondcheongzx committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    701b4ae View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Fix tests

    @desmondcheongzx
    desmondcheongzx committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    d05d7e7 View commit details
    Browse the repository at this point in the history

  2. Import pyarrow lazily

    @desmondcheongzx
    desmondcheongzx committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    94a9779 View commit details
    Browse the repository at this point in the history

  3. Lazily register HTML visualization hooks

    @desmondcheongzx
    desmondcheongzx committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    b48e3cb View commit details
    Browse the repository at this point in the history

  4. Separate type checking imports from actual imports

    @desmondcheongzx
    desmondcheongzx committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    3faeb8e View commit details
    Browse the repository at this point in the history

  5. Undo poc artifact

    @desmondcheongzx
    desmondcheongzx committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    6aa2828 View commit details
    Browse the repository at this point in the history

  6. Ban expensive imports with linter

    @desmondcheongzx
    desmondcheongzx committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    a8c5a46 View commit details
    Browse the repository at this point in the history

  7. Fix tests

    @desmondcheongzx
    desmondcheongzx committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    e91afbc View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Add flake8-type-checking

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    ce44aab View commit details
    Browse the repository at this point in the history

  2. Move all lazy imports into dependencies module

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    988e359 View commit details
    Browse the repository at this point in the history

  3. Fix csv test

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    f30b20e View commit details
    Browse the repository at this point in the history

  4. Attempt fix

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    826c715 View commit details
    Browse the repository at this point in the history

  5. Test another fix

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    d0a1fce View commit details
    Browse the repository at this point in the history

  6. Fix test?

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    bddcce6 View commit details
    Browse the repository at this point in the history

  7. Fix ray runner tests

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    3052f24 View commit details
    Browse the repository at this point in the history

  8. Add action upterm

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    ed8061c View commit details
    Browse the repository at this point in the history

  9. Fix upterm

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    a583631 View commit details
    Browse the repository at this point in the history

  10. Fix upterm

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    3580b26 View commit details
    Browse the repository at this point in the history

  11. Set timeout

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    55cace6 View commit details
    Browse the repository at this point in the history

  12. Tweak

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    9d26e3b View commit details
    Browse the repository at this point in the history

  13. Delay upterm

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    e41737e View commit details
    Browse the repository at this point in the history

  14. Remove upterm

    @desmondcheongzx
    desmondcheongzx committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    d300ce9 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Break up build and test

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    1508747 View commit details
    Browse the repository at this point in the history

  2. Jiggle

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    a71d072 View commit details
    Browse the repository at this point in the history

  3. test

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    4835c92 View commit details
    Browse the repository at this point in the history

  4. jiggle

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    2d2e8d1 View commit details
    Browse the repository at this point in the history

  5. jiggle

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    81e76a6 View commit details
    Browse the repository at this point in the history

  6. getting

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ebafdf7 View commit details
    Browse the repository at this point in the history

  7. jiggle

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    513c425 View commit details
    Browse the repository at this point in the history

  8. test pyarrow version

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    463294a View commit details
    Browse the repository at this point in the history

  9. jiggle

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f28f8e8 View commit details
    Browse the repository at this point in the history

  10. modify

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    7f692f6 View commit details
    Browse the repository at this point in the history

  11. Fix

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    4496d1f View commit details
    Browse the repository at this point in the history

  12. Fix

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    8e25dbc View commit details
    Browse the repository at this point in the history

  13. Remove ssh

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f7be46d View commit details
    Browse the repository at this point in the history

  14. Cleanup

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    faaf4f1 View commit details
    Browse the repository at this point in the history

  15. Import numpy via daft.dependencies for ray runner

    @desmondcheongzx
    desmondcheongzx committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f888e49 View commit details
    Browse the repository at this point in the history