Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Diagnostic failure for recipe_lauer22jclim_fig3-4_zonal.yml on v2.11.0rc1 #2427

Closed
chrisbillowsMO opened this issue May 20, 2024 · 1 comment · Fixed by #2428
Closed

Diagnostic failure for recipe_lauer22jclim_fig3-4_zonal.yml on v2.11.0rc1 #2427

chrisbillowsMO opened this issue May 20, 2024 · 1 comment · Fixed by #2428

Comments

@chrisbillowsMO
Copy link
Contributor

chrisbillowsMO commented May 20, 2024

Describe the bug

This recipe is failing as noted in:

  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/_main.py",\
 line 413, in run
    self._run(recipe, session)
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/_main.py",\
 line 455, in _run
    process_recipe(recipe_file=recipe, session=session)
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/_main.py",\
 line 130, in process_recipe
    recipe.run()
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/_recipe/re\
cipe.py", line 1095, in run
    self.tasks.run(max_parallel_tasks=self.session['max_parallel_tasks'])
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/_task.py",\
 line 736, in run
    self._run_sequential()
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/_task.py",\
 line 747, in _run_sequential
    task.run()
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/_task.py",\
 line 260, in run
    input_files.extend(task.run())
                       ^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/_task.py",\
 line 264, in run
    self.output_files = self._run(input_files)
                        ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/preprocess\
or/__init__.py", line 684, in _run
    product.apply(step, self.debug)
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/preprocess\
or/__init__.py", line 492, in apply
    self.cubes = preprocess(self.cubes, step,
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/preprocess\
or/__init__.py", line 401, in preprocess
    result.append(_run_preproc_function(function, item, settings,
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/preprocess\
or/__init__.py", line 346, in _run_preproc_function
    return function(items, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/preprocess\
or/_shared.py", line 262, in wrapper
    result = func(data, *args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/preprocess\
or/_regrid.py", line 1243, in extract_levels
    cube = _rechunk_aux_factory_dependencies(cube, coordinate)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/esmvalcore/preprocess\
or/_regrid.py", line 1168, in _rechunk_aux_factory_dependencies
    coord.points = coord.lazy_points().rechunk(chunks)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/dask/array/core.py", \
line 2770, in rechunk
    return rechunk(self, chunks, threshold, block_size_limit, balance, method)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/dask/array/rechunk.py\
", line 347, in rechunk
    chunks = normalize_chunks(
             ^^^^^^^^^^^^^^^^^
  File "/home/b/b382148/miniforge3/envs/esmvaltool-core2.11.0rc1/lib/python3.11/site-packages/dask/array/core.py", \
line 3075, in normalize_chunks
    raise ValueError(
ValueError: Chunks and shape must be of the same length/dimension. Got chunks=(), shape=(1,)
@ehogan
Copy link
Contributor

ehogan commented May 20, 2024

@chrisbillowsMO and I identified the problem was coming from the _rechunk_aux_factory_dependencies function, specifically that, in one case within this recipe, coord_dims was () rather than None, so the if loop was being entered when it shouldn't have been. Fixed in #2428.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants