Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Fix Databricks failed cases when Time zone is non-UTC #9792

Open
2 tasks
res-life opened this issue Nov 20, 2023 · 2 comments
Open
2 tasks

[FEA] Fix Databricks failed cases when Time zone is non-UTC #9792

res-life opened this issue Nov 20, 2023 · 2 comments
Labels
task Work required that improves the product but is not user facing test Only impacts tests

Comments

@res-life
Copy link
Collaborator

res-life commented Nov 20, 2023

Is your feature request related to a problem? Please describe.
Spark-Rapids currently does not support legacy rebase mode when TZ is non-UTC.

For non-UTC time zone, DB failed some cases because of DB default timestamp rebase mode is legacy which is different with regular Spark.

Describe the solution you'd like

  • Fix existing cases
  • Add cases that do not rely on default mode: Testing all the rebase mode.

Describe alternatives you've considered

Additional context

@res-life res-life added feature request New feature or request ? - Needs Triage Need team to review and classify labels Nov 20, 2023
@sameerz sameerz added test Only impacts tests task Work required that improves the product but is not user facing and removed feature request New feature or request ? - Needs Triage Need team to review and classify labels Nov 21, 2023
@res-life res-life self-assigned this Dec 19, 2023
@res-life
Copy link
Collaborator Author

Can we change this to release 24.04.
For US costomers, they are using DST (Day Light Saving) time zone, we can not support DST time zone in realse 24.02.
For China customers, they do not use Databricks.

@res-life
Copy link
Collaborator Author

Not planing work on this for release 24.04, unassign it from me.

@res-life res-life removed their assignment Mar 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
task Work required that improves the product but is not user facing test Only impacts tests
Projects
None yet
Development

No branches or pull requests

2 participants