New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[serve] Add replica queue length caching to replica scheduler #42943

Merged

edoakes merged 39 commits into ray-project:master from edoakes:new-routing

Feb 7, 2024

Merged

[serve] Add replica queue length caching to replica scheduler #42943

fix

DCO / DCO succeeded Feb 7, 2024 in 1s

DCO

All commits are signed off!

View more details on DCO