Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[data] Fix pandas import failures by moving it to a top-level data import #32447

Merged
merged 2 commits into from
Feb 14, 2023

Conversation

ericl
Copy link
Contributor

@ericl ericl commented Feb 10, 2023

Why are these changes needed?

This fixes #32435

I still do not know the exact root cause. I tried bisecting as far back as streaming worked, and it still happened before (though less frequently). It's possible this was a long outstanding issue.

I am not able to reproduce without streaming.

This PR sidesteps the issue by making pandas a normal import, which does not trigger the issue.

  • This does mean pandas gets imported a little earlier, but that shouldn't have any semantic implications, unless someone is referencing ray.data without using any of its APIs.
  • We can try to remove pandas as a hard dependency in the longer term.

Related issue number

Closes #32435

@ericl ericl added the tests-ok The tagger certifies test failures are unrelated and assumes personal liability. label Feb 11, 2023
@ericl ericl merged commit bc01288 into ray-project:master Feb 14, 2023
cadedaniel added a commit that referenced this pull request Feb 14, 2023
clarkzinzow pushed a commit that referenced this pull request Feb 14, 2023
edoakes pushed a commit to edoakes/ray that referenced this pull request Mar 22, 2023
edoakes pushed a commit to edoakes/ray that referenced this pull request Mar 22, 2023
elliottower pushed a commit to elliottower/ray that referenced this pull request Apr 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tests-ok The tagger certifies test failures are unrelated and assumes personal liability.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[core] [data] Pandas has no attribute 'core' likely due to race with import thread
4 participants