Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[core][state] Worker launch time incorrect for driver #35130

Closed
rickyyx opened this issue May 8, 2023 · 1 comment · Fixed by #43516
Closed

[core][state] Worker launch time incorrect for driver #35130

rickyyx opened this issue May 8, 2023 · 1 comment · Fixed by #43516
Assignees
@hongchaodeng
Labels
bug Something that is supposed to be working; but isn't core Issues that should be addressed in Ray Core core-observability good first issue Great starter issue for someone just starting to contribute to Ray observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling P1 Issue that should be fixed within a few weeks stability
Milestone
Ray State Observa...

Comments

@rickyyx
Copy link
Contributor

rickyyx commented May 8, 2023

What happened + What you expected to happen

-   worker_id: 01000000ffffffffffffffffffffffffffffffffffffffffffffffff
    is_alive: false
    worker_type: DRIVER
    exit_type: INTENDED_USER_EXIT
    node_id: 169643245001a3fd78e69da6084d3306fb8d7e312f19a6ee88183fdf
    ip: 127.0.0.1
    pid: 44527
    exit_detail: Shutdown by ray.shutdown().
    worker_launch_time_ms: 18446744073709551615
    worker_launched_time_ms: 18446744073709551615
    start_time_ms: '2023-05-08 21:36:46.864000'
    end_time_ms: '2023-05-08 21:36:47.977000'

where

    worker_launch_time_ms: 18446744073709551615
    worker_launched_time_ms: 18446744073709551615

Versions / Dependencies

master

Reproduction script

run a driver script and then ray list workers --detail

Issue Severity

None
@rickyyx rickyyx added bug Something that is supposed to be working; but isn't good first issue Great starter issue for someone just starting to contribute to Ray P1 Issue that should be fixed within a few weeks core Issues that should be addressed in Ray Core observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling labels May 8, 2023
@rickyyx rickyyx added this to the Ray State Observability milestone May 8, 2023
@rickyyx rickyyx self-assigned this May 8, 2023
@rickyyx rickyyx mentioned this issue May 8, 2023
Merged
8 tasks
@ProjectsByJackHe
Copy link
Contributor

ProjectsByJackHe commented May 13, 2023 •
edited
Loading

What happened + What you expected to happen

-   worker_id: 01000000ffffffffffffffffffffffffffffffffffffffffffffffff
    is_alive: false
    worker_type: DRIVER
    exit_type: INTENDED_USER_EXIT
    node_id: 169643245001a3fd78e69da6084d3306fb8d7e312f19a6ee88183fdf
    ip: 127.0.0.1
    pid: 44527
    exit_detail: Shutdown by ray.shutdown().
    worker_launch_time_ms: 18446744073709551615
    worker_launched_time_ms: 18446744073709551615
    start_time_ms: '2023-05-08 21:36:46.864000'
    end_time_ms: '2023-05-08 21:36:47.977000'

where

    worker_launch_time_ms: 18446744073709551615
    worker_launched_time_ms: 18446744073709551615

Versions / Dependencies

master

Reproduction script

run a driver script and then ray list workers --detail

Issue Severity

None

Yeah I have no idea why this is happening. I suspect it doesn't have anything to do with the formatting logic, but maybe with the way the data is generated in the first place?

@14leeyuchieh 14leeyuchieh mentioned this issue Jun 1, 2023
Closed
7 tasks
@hongchaodeng hongchaodeng self-assigned this Feb 28, 2024
@hongchaodeng hongchaodeng mentioned this issue Feb 28, 2024
Merged
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hongchaodeng hongchaodeng

Labels
bug Something that is supposed to be working; but isn't core Issues that should be addressed in Ray Core core-observability good first issue Great starter issue for someone just starting to contribute to Ray observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling P1 Issue that should be fixed within a few weeks stability
Projects
None yet
Milestone
Ray State Observability
Development

Successfully merging a pull request may close this issue.

[core] fix worker launch time formatting hongchaodeng/ray
4 participants
@hongchaodeng @rickyyx @ProjectsByJackHe @anyscalesam