Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [Serve] Spammy error every 50ms when deployment not ready #19201

Closed
2 tasks done
simon-mo opened this issue Oct 7, 2021 · 0 comments · Fixed by #19205
Closed
2 tasks done

[Bug] [Serve] Spammy error every 50ms when deployment not ready #19201

simon-mo opened this issue Oct 7, 2021 · 0 comments · Fixed by #19205
Assignees
Labels
bug Something that is supposed to be working; but isn't serve Ray Serve Related Issue

Comments

@simon-mo
Copy link
Contributor

simon-mo commented Oct 7, 2021

Search before asking

  • I searched the issues and found no similar issues.

Ray Component

Ray Serve

What happened + What you expected to happen

Spammy logs from dashboard.log when deployments are pending

2021-10-07 10:01:50,192 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,197 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,202 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,208 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,213 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,220 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,225 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,231 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,236 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,242 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,248 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,253 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,259 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,264 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,270 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,276 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,284 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,289 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,295 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365
2021-10-07 10:01:50,302 INFO node_head.py:292 -- Received error entry for 10.16.0.141, repr=<ray.serve.controller.ServeController object at 0x7f2520030e50> 365

Reproduction script

from ray import serve

serve.start()

@serve.deployment(ray_actor_options=dict(num_cpus=100))
def f(_):
    return "hello"

f.deploy()

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!
@simon-mo simon-mo added bug Something that is supposed to be working; but isn't serve Ray Serve Related Issue labels Oct 7, 2021
@simon-mo simon-mo self-assigned this Oct 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something that is supposed to be working; but isn't serve Ray Serve Related Issue
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant