Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Serve] No http latency metrics #32711

Closed
sihanwang41 opened this issue Feb 21, 2023 · 0 comments · Fixed by #32839
Closed

[Serve] No http latency metrics #32711

sihanwang41 opened this issue Feb 21, 2023 · 0 comments · Fixed by #32839
Assignees
@sihanwang41
Labels
bug Something that is supposed to be working; but isn't P1 Issue that should be fixed within a few weeks serve Ray Serve Related Issue

Comments

@sihanwang41
Copy link
Contributor

sihanwang41 commented Feb 21, 2023 •
edited
Loading

What happened + What you expected to happen

In ray serve, it only has single request processing latency within replica. Besides it is useful to have top level HTTP request latency to measure how long it takes to send response to the client. (e.g. retry, deployment graph use case)

Versions / Dependencies

master

Reproduction script

N/A

Issue Severity

None
@sihanwang41 sihanwang41 added bug Something that is supposed to be working; but isn't P1 Issue that should be fixed within a few weeks triage Needs triage (eg: priority, bug/not-bug, and owning component) labels Feb 21, 2023
@sihanwang41 sihanwang41 self-assigned this Feb 21, 2023
@sihanwang41 sihanwang41 added serve Ray Serve Related Issue and removed triage Needs triage (eg: priority, bug/not-bug, and owning component) labels Feb 21, 2023
@sihanwang41 sihanwang41 mentioned this issue Feb 25, 2023
Merged
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sihanwang41 sihanwang41

Labels
bug Something that is supposed to be working; but isn't P1 Issue that should be fixed within a few weeks serve Ray Serve Related Issue
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Serve] Add http request latency sihanwang41/ray
1 participant
@sihanwang41