Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: handling client disconnect gracefully by propagating cancellation exception up to the chat completion handler #185

Open
wants to merge 18 commits into
base: development
Choose a base branch
from
Open

fix: handling client disconnect gracefully by propagating cancellation exception up to the chat completion handler #185

wants to merge 18 commits into from
+265 −77

Commits on Nov 11, 2024

  1. fix: solution #1 part 1

    @adubovik
    adubovik committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    d0b3ca6 View commit details
    Browse the repository at this point in the history

  2. feat: added tests for cancellation

    @adubovik
    adubovik committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    bf26d90 View commit details
    Browse the repository at this point in the history

  3. feat: migrated cancellation tests from ConditionWithValue to asyncio.… 

    …Future
    @adubovik
    adubovik committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    d416b47 View commit details
    Browse the repository at this point in the history

  4. feat: migrated to custom made TaskGroup class

    @adubovik
    adubovik committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    18a177e View commit details
    Browse the repository at this point in the history

  5. feat: refactored Response._generate_stream

    @adubovik
    adubovik committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    7c25665 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. fix: fixes tests

    @adubovik
    adubovik committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    964977d View commit details
    Browse the repository at this point in the history

  2. feat: refactored _generate_stream_with_factory

    @adubovik
    adubovik committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    8feb7c4 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. fix: removed redundant import

    @adubovik
    adubovik committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    a63b69d View commit details
    Browse the repository at this point in the history

  2. feat: added asyncio.TaskGroup from py3.11

    @adubovik
    adubovik committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    6494751 View commit details
    Browse the repository at this point in the history

  3. fix: minor response refactoring

    @adubovik
    adubovik committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1ffe3df View commit details
    Browse the repository at this point in the history

  4. Merge branch 'development' into fix/propagate-cancellation-error

    @adubovik
    adubovik committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    9754d9b View commit details
    Browse the repository at this point in the history

  5. feat: introduces CancelScope class

    @adubovik
    adubovik committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    74ec51f View commit details
    Browse the repository at this point in the history

  6. fix: removed copy of asyncio.TaskGroup

    @adubovik
    adubovik committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    67fe430 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. fix: minor renaming in CancelScope class

    @adubovik
    adubovik committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    aee6de4 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. Merge branch 'development' into fix/propagate-cancellation-error

    @adubovik
    adubovik committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    d2563ec View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2024

  1. fix: review fix

    @adubovik
    adubovik committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    6e45f26 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2024

  1. feat: added more tests for cancellation logic

    @adubovik
    adubovik committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    4a62262 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'development' into fix/propagate-cancellation-error

    @adubovik
    adubovik committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    daec65e View commit details
    Browse the repository at this point in the history