-
-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix zarr append with groups #3610
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @niowniow.
This looks OK to me but I don't know the zarr code.
@niowniow can you merge master please? The diff is huge right now |
I tried to merge with master yesterday and did it again today. There might be a problem with the way I tried to fix the |
If you don't mind I'll try to fix that for you. |
I don't mind, thanks :) |
I cherry-picked your commits, but I'm not sure I included all the changes. Could you check that? Also, I can't seem to figure out how to push to this PR, so you will have to do that instead: git checkout fix_zarr_append_with_groups
# backup branch
git branch backup_fix_zarr_append_with_groups
# delete branch
git checkout master
git branch -D fix_zarr_append_with_groups
# checkout fixed branch
git checkout --track origin/fix_zarr_append_with_groups
# force push
git push -f <fork-remote> fix_zarr_append_with_groups |
daa111b
to
2152b42
Compare
Okay, this looks better. Thanks for the help! I had to try it again myself, because you cherry-picked some commits I accidentally merged into this branch (non-related to this fix). |
Looks good to me. However, I don't know much about backends so I'll let someone else review the code. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry for my very slow review of this. I just looked over the PR and found zero issues. Thanks for your patience.
@dcherian - I assume these test failures (py38-upstream-dev and docs) are acceptable? They seem unrelated to the PR. If so, please merge. |
the upstream-dev failure is #3751, but although there should be no change here that would trigger it, the docs failure (referencing |
I can't find that message here: https://dev.azure.com/xarray/xarray/_build/results?buildId=2214&view=logs&jobId=7e620c85-24a8-5ffa-8b1f-642bc9b1fc36&j=7e620c85-24a8-5ffa-8b1f-642bc9b1fc36&t=68484831-0a19-5145-bfe9-6309e5f7691d To me it looks like the doc build failed due to two warnings: failure to fetch the pandas intersphinx obj and a sphinx deprecation warning about scripts. |
it's here:
not sure if the intersphinx warning also makes the build fail, but that could be fixed by rerunning. The deprecation warning is not a problem. |
All tests are green. Thanks @niowniow. I see this is your first contribution. Welcome! |
…e-size * upstream/master: (24 commits) Fix alignment with join="override" when some dims are unindexed (pydata#3839) Fix CFTimeIndex-related errors stemming from updates in pandas (pydata#3764) Doctests fixes (pydata#3846) add xpublish to related projects (pydata#3850) update installation instruction (pydata#3849) Pint support for top-level functions (pydata#3611) un-xfail tests that append to netCDF files with scipy (pydata#3805) remove panel conversion (pydata#3845) Add nxarray to related-projects.rst (pydata#3848) Implement skipna kwarg in xr.quantile (pydata#3844) Allow `where` to receive a callable (pydata#3827) update macos image (pydata#3838) Label "Installed Versions" item in Issue template (pydata#3832) Add note on diff's n differing from pandas (pydata#3822) DOC: Add rioxarray and other external examples (pydata#3757) Use stable RTD image. removed mention that 'dims' are inferred from 'coords'-dict when omit… (pydata#3821) Coarsen keep attrs 3376 (pydata#3801) Turn on html repr by default (pydata#3812) Fix zarr append with groups (pydata#3610) ...
Fixes the issue that
xarray.core.dataset.Dataset.to_zarr
produced errors when usingappend_dim
andgroup
simultaneously. The issue was that during appending, the zarr store was opened without the group information.black . && mypy . && flake8
whats-new.rst
for all changes andapi.rst
for new API