Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AirbyteEstimateTraceMessage and UI sync Estimates - Progress Bars #18630

Closed
wants to merge 24 commits into from
Closed

AirbyteEstimateTraceMessage and UI sync Estimates - Progress Bars #18630

wants to merge 24 commits into from

Commits on Oct 28, 2022

  1. AirbyteEstimateTraceMessage

    @evantahler
    evantahler committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    2edfb70 View commit details
    Browse the repository at this point in the history

  2. upper-case enum options

    @evantahler
    evantahler committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    970c799 View commit details
    Browse the repository at this point in the history

  3. Faker emits TraceEstimateMessages

    @evantahler
    evantahler committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    6cf24c5 View commit details
    Browse the repository at this point in the history

  4. move emitted_at

    @evantahler
    evantahler committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    b759a72 View commit details
    Browse the repository at this point in the history

  5. Mock out job history handler so we have running throughput.

    @davinchia
    davinchia committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    5f3466e View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2022

  1. Also mock the jobs/list api.

    @davinchia
    davinchia committed Oct 29, 2022
    Configuration menu
    Copy the full SHA
    d0355ca View commit details
    Browse the repository at this point in the history

  2. [wip] top-level progress bar

    @evantahler
    evantahler committed Oct 29, 2022
    Configuration menu
    Copy the full SHA
    8c176f5 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2022

  1. Merge branch 'master' into evan-davin/hack-day-progress

    @davinchia
    davinchia authored Oct 31, 2022
    Configuration menu
    Copy the full SHA
    92f1f26 View commit details
    Browse the repository at this point in the history

  2. UI Basics

    @evantahler
    evantahler committed Oct 31, 2022
    Configuration menu
    Copy the full SHA
    5a1c0b7 View commit details
    Browse the repository at this point in the history

  3. time estimates

    @evantahler
    evantahler committed Oct 31, 2022
    Configuration menu
    Copy the full SHA
    848ee72 View commit details
    Browse the repository at this point in the history

  4. fix test

    @evantahler
    evantahler committed Oct 31, 2022
    Configuration menu
    Copy the full SHA
    d422544 View commit details
    Browse the repository at this point in the history

  5. more localization

    @evantahler
    evantahler committed Oct 31, 2022
    Configuration menu
    Copy the full SHA
    eb10300 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2022

  1. estimate throughput

    @evantahler
    evantahler committed Nov 1, 2022
    Configuration menu
    Copy the full SHA
    f9d510d View commit details
    Browse the repository at this point in the history

  2. Include byte estimates

    @evantahler
    evantahler committed Nov 1, 2022
    Configuration menu
    Copy the full SHA
    15538ef View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into evan-davin/hack-day-progress

    @evantahler
    evantahler authored Nov 1, 2022
    Configuration menu
    Copy the full SHA
    05297da View commit details
    Browse the repository at this point in the history

  4. update display when now estimate is present

    @evantahler
    evantahler committed Nov 1, 2022
    Configuration menu
    Copy the full SHA
    8976ef8 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2022

  1. Backend changes to support saving state mid progress. (#18723) 

    - introduce and implement save_stats route
- add estimated columns to sync_stats table
- all intermediate persistence layer changes to support this
- job persistence tests for general sanity check
- job/list and get_debug_info now returns totalStats
- per-stream stats to be implement as follow up
    @davinchia
    davinchia authored Nov 2, 2022
    Configuration menu
    Copy the full SHA
    6867085 View commit details
    Browse the repository at this point in the history

  2. support for just displaying totals

    @evantahler
    evantahler committed Nov 2, 2022
    Configuration menu
    Copy the full SHA
    109411c View commit details
    Browse the repository at this point in the history

  3. display progressive enhancment

    @evantahler
    evantahler committed Nov 2, 2022
    Configuration menu
    Copy the full SHA
    e19f727 View commit details
    Browse the repository at this point in the history

  4. Save and return per stream stats. (#18834) 

    * Add the streamStats variable to the api route and implement replication worker sending of stream stats.

* Implement migration to add JSONB streamStats column to SyncStats table.

* Implement writing of stream stats to db.

* Implement this for per-stream.
    @davinchia
    davinchia authored Nov 2, 2022
    Configuration menu
    Copy the full SHA
    1f492ca View commit details
    Browse the repository at this point in the history

  5. formatting fixes

    @evantahler
    evantahler committed Nov 2, 2022
    Configuration menu
    Copy the full SHA
    4438dd0 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'evan-davin/hack-day-progress' of github.com:airbytehq/a… 

    …irbyte into evan-davin/hack-day-progress
    @evantahler
    evantahler committed Nov 2, 2022
    Configuration menu
    Copy the full SHA
    7b090dd View commit details
    Browse the repository at this point in the history

  7. better source estimate

    @evantahler
    evantahler committed Nov 2, 2022
    Configuration menu
    Copy the full SHA
    b7ed66f View commit details
    Browse the repository at this point in the history

  8. show/hide streams

    @evantahler
    evantahler committed Nov 2, 2022
    Configuration menu
    Copy the full SHA
    1445e7f View commit details
    Browse the repository at this point in the history