forked from NOAA-GSL/global-workflow
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge to 2024 Jan 12 NOAA-EMC/develop.
Squashed commit of the following: commit c590476 Author: Rahul Mahajan <[email protected]> Date: Fri Jan 12 19:21:02 2024 -0500 Update hash to ufs-weather-model. The noahmptable.tbl was reorganized, so update link_workflow.sh to use the same one used in UFSWM RT (NOAA-EMC#2219) commit c041968 Author: Kate Friedman <[email protected]> Date: Fri Jan 12 12:09:35 2024 -0500 Add ocean resolution to setup_expt invocation and retire/reduce COMROT/ROTDIR usage (NOAA-EMC#2214) Two series of updates: 1) Update setup scripts to now allow users to provide ocean resolution 2) Housekeeping to retire the `COMROT` variable, replacing it with other variables as needed, and reduce the `ROTDIR` variable usage. Both updates change options for the workflow setup API. Refs NOAA-EMC#2061 commit 997f978 Author: AndrewEichmann-NOAA <[email protected]> Date: Fri Jan 12 10:46:36 2024 -0500 Allow use of ocean obs prep in WCDA cycling and remove R2D2 (NOAA-EMC#2215) Enables use of ocean obs prep task in WCDA cycling and removes R2D2 from same. Runs task gdasprepoceanobs before gdasocnanalprep -- obtains ocean data nc4 files from DMPDIR, processes them into IODA format and copies them to COM_OBS. Replaces the current R2D2 processing. commit 12a5bb1 Merge: 4cb5802 6492c2d Author: David Huber <[email protected]> Date: Fri Jan 12 09:26:27 2024 -0500 Merge pull request NOAA-EMC#2217 from DavidHuber-NOAA/update/versions Update and clean up version and module files commit 6492c2d Author: David Huber <[email protected]> Date: Thu Jan 11 11:49:08 2024 -0600 Update orion module/version files for met/metplus NOAA-EMC#2123 commit 94c9937 Author: DavidHuber <[email protected]> Date: Thu Jan 11 17:42:53 2024 +0000 Comment met/metplus out from Hera modulefile. NOAA-EMC#2123 commit 8c32f8b Merge: a65e4c6 4cb5802 Author: David Huber <[email protected]> Date: Thu Jan 11 11:34:44 2024 -0600 Merge branch 'develop' of github.com:noaa-emc/global-workflow into develop commit a65e4c6 Author: David Huber <[email protected]> Date: Thu Jan 11 11:34:19 2024 -0600 Initial update of version/module files NOAA-EMC#2123 commit 4cb5802 Author: souopgui <[email protected]> Date: Wed Jan 10 08:30:22 2024 -0600 Fix OpenMP over-allocation of resources in exglobal_atmos_products.sh when running MPMD tasks (NOAA-EMC#2212) Fix OpenMP over-allocation of resources running MPMD tasks Co-authored-by: Innocent Souopgui <[email protected]> commit b056b53 Author: TerrenceMcGuinness-NOAA <[email protected]> Date: Mon Jan 8 17:28:05 2024 -0500 Add Hercules as valid machine in CI scripts (NOAA-EMC#2207) Few updates to CI scripts to include names for hercules that where missed the first time. commit 6574d29 Author: Rahul Mahajan <[email protected]> Date: Mon Jan 8 17:25:47 2024 -0500 Fix invalid GH action and restart file name (NOAA-EMC#2210) Resolves a typo that leads to an invalid workflow yaml and fixes the restart filename in restart detection. Resolves NOAA-EMC#2205 commit 69605ea Author: Rahul Mahajan <[email protected]> Date: Mon Jan 8 17:00:28 2024 -0500 Stop attempting to comment link to RTD for non-PRs (NOAA-EMC#2209) Adds a check so comments with a link to documentation are only generated for PRs. commit 4e160a8 Author: Rahul Mahajan <[email protected]> Date: Mon Jan 8 13:10:15 2024 -0500 Enable UPP for GOES processing (NOAA-EMC#2203) Wnables the creation of special master grib2 files from UPP for GOES processing commit c15875b Author: David Huber <[email protected]> Date: Mon Jan 8 09:56:06 2024 -0500 Port cycling to Hercules (NOAA-EMC#2196) Adds cycled support for Hercules (excluding gsi-monitor). Partially resolves NOAA-EMC#1588 GSI monitoring is disabled on Hercules due to missing Perl modules. That will be enabled in a later PR. commit ef6827d Author: Walter Kolczynski - NOAA <[email protected]> Date: Mon Jan 8 09:43:12 2024 -0500 Refactor rocoto task XML creation (NOAA-EMC#2189) Refactors the rocoto task generation to be recursive. This will allow nested metatasks to loop over multiple variables, which is needed for GEFS product generation. As part of this refactor, there is no longer separate arguments to designate metatasks. Instead, task dicts can include a nested 'task_dict' as well as a 'var_dict' containing the variables to loop over. The nested task dict can then either have another layer, or be the innermost task. To accommodate the new recursive nature, some defaults that were previously defined in create_wf_task() had to be pushed down into the function that creates the innermost task. Also, former keywords have been absorbed by the task dict. Refs NOAA-EMC#823 Refs NOAA-EMC#827 commit 2b81cfa Author: Walter Kolczynski - NOAA <[email protected]> Date: Mon Jan 8 09:41:03 2024 -0500 Update fix versions (NOAA-EMC#2198) Updates fix versions for a few components: - Update cice and mom6 versions to support C96/1p00 marine - Update wave to change betamax setting for glo_025 waves Resolves NOAA-EMC#2004 Resolves NOAA-EMC#2107
- Loading branch information
1 parent
e7a8151
commit 9e0d134
Showing
81 changed files
with
2,134 additions
and
735 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,4 +1,4 @@ | ||
defaults: | ||
!INC {{ HOMEgfs }}/parm/config/gefs/yaml/defaults.yaml | ||
base: | ||
ACCOUNT: ${SLURM_ACCOUNT} | ||
ACCOUNT: {{ 'SLURM_ACCOUNT' | getenv }} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,4 +1,4 @@ | ||
defaults: | ||
!INC {{ HOMEgfs }}/parm/config/gfs/yaml/defaults.yaml | ||
base: | ||
ACCOUNT: ${SLURM_ACCOUNT} | ||
ACCOUNT: {{ 'SLURM_ACCOUNT' | getenv }} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -391,7 +391,7 @@ The chgres jobs will have a dependency on the data-pull jobs and will wait to ru | |
|
||
5. Check output: | ||
|
||
In the config you will have defined an output folder called ``$OUTDIR``. The converted output will be found there, including the needed abias and radstat initial condition files (if CDUMP=gdas). The files will be in the needed directory structure for the global-workflow system, therefore a user can move the contents of their ``$OUTDIR`` directly into their ``$ROTDIR/$COMROT``. | ||
In the config you will have defined an output folder called ``$OUTDIR``. The converted output will be found there, including the needed abias and radstat initial condition files (if CDUMP=gdas). The files will be in the needed directory structure for the global-workflow system, therefore a user can move the contents of their ``$OUTDIR`` directly into their ``$ROTDIR``. | ||
|
||
Please report bugs to George Gayno ([email protected]) and Kate Friedman ([email protected]). | ||
|
||
|
@@ -449,7 +449,7 @@ The warm starts and other output from production are at C768 deterministic and C | |
What files should you pull for starting a new experiment with warm starts from production? | ||
------------------------------------------------------------------------------------------ | ||
|
||
That depends on what mode you want to run -- forecast-only or cycled. Whichever mode, navigate to the top of your ``COMROT`` and pull the entirety of the tarball(s) listed below for your mode. The files within the tarball are already in the ``$CDUMP.$PDY/$CYC/$ATMOS`` folder format expected by the system. | ||
That depends on what mode you want to run -- forecast-only or cycled. Whichever mode, navigate to the top of your ``ROTDIR`` and pull the entirety of the tarball(s) listed below for your mode. The files within the tarball are already in the ``$CDUMP.$PDY/$CYC/$ATMOS`` folder format expected by the system. | ||
|
||
For forecast-only there are two tarballs to pull | ||
|
||
|
@@ -489,7 +489,7 @@ Tarballs per cycle: | |
com_gfs_vGFSVER_enkfgdas.YYYYMMDD_CC.enkfgdas_restart_grp7.tar | ||
com_gfs_vGFSVER_enkfgdas.YYYYMMDD_CC.enkfgdas_restart_grp8.tar | ||
|
||
Go to the top of your ``COMROT/ROTDIR`` and pull the contents of all tarballs there. The tarballs already contain the needed directory structure. | ||
Go to the top of your ``ROTDIR`` and pull the contents of all tarballs there. The tarballs already contain the needed directory structure. | ||
|
||
.. _warmstarts-preprod-parallels: | ||
|
||
|
@@ -514,7 +514,7 @@ Recent pre-implementation parallel series was for GFS v16 (implemented March 202 | |
+ ../$GDATE/gdas_restartb.tar | ||
+ ../$GDATE/enkfgdas_restartb_grp##.tar (where ## is 01 through 08) (note, older tarballs may include a period between enkf and gdas: "enkf.gdas") | ||
|
||
* **Where do I put the warm-start initial conditions?** Extraction should occur right inside your COMROT. You may need to rename the enkf folder (enkf.gdas.$PDY -> enkfgdas.$PDY). | ||
* **Where do I put the warm-start initial conditions?** Extraction should occur right inside your ROTDIR. You may need to rename the enkf folder (enkf.gdas.$PDY -> enkfgdas.$PDY). | ||
|
||
Due to a recent change in the dycore, you may also need an additional offline step to fix the checksum of the NetCDF files for warm start. See the :ref:`Fix netcdf checksum section <gfsv17-checksum>`. | ||
|
||
|
@@ -602,5 +602,5 @@ And then on all platforms: | |
|
||
:: | ||
|
||
cd $COMROT | ||
cd $ROTDIR | ||
for f in $(find ./ -name *tile*.nc); do echo $f; ncatted -a checksum,,d,, $f; done |
Oops, something went wrong.