Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature #2833 pcp_combine_missing #2886

Merged
merged 13 commits into from
May 15, 2024
Merged

Feature #2833 pcp_combine_missing #2886

Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
640b9cd
Per #2883, add -input_thresh command line option to configure allowab…
JohnHalleyGotway May 10, 2024
7dde651
Per #2883, update pcp_combine usage statement.
JohnHalleyGotway May 10, 2024
a4f99a0
Per #2883, update existing pcp_combine -derive unit test example by a…
JohnHalleyGotway May 10, 2024
d81447a
Per #2883, update the pcp_combine logic for the sum command to allow …
JohnHalleyGotway May 11, 2024
ccc3506
Update docs/Users_Guide/reformat_grid.rst
JohnHalleyGotway May 13, 2024
fbdee48
Per #2883, update pcp_combine usage statement in the code to be more …
JohnHalleyGotway May 13, 2024
9262654
Per #2883, switch to using derive_file_list_missing as the one contai…
JohnHalleyGotway May 13, 2024
a3bc1fa
Per #2883, move initialization inside the same loop to resolve SonarQ…
JohnHalleyGotway May 13, 2024
c0c5286
Per #2883, update sum_data_files() to switch from allocating memory t…
JohnHalleyGotway May 13, 2024
33d6973
Per #2883, changes to declarations of variables to satisfy SonarQube.
JohnHalleyGotway May 13, 2024
592cf89
Per #2883, address more SonarQube issues
JohnHalleyGotway May 13, 2024
e50cfd3
Per #2883, backing out an unintended change I made to tcrmw_grid.cc. …
JohnHalleyGotway May 13, 2024
96d0d67
Per #2883, update logic of parse_file_list_type() function to handle …
JohnHalleyGotway May 14, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 7 additions & 4 deletions docs/Users_Guide/reformat_grid.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ The usage statement for the Pcp-Combine tool is shown below:
out_file
[-field string]
[-name list]
[-input_thresh n]
[-vld_thresh n]
[-log file]
[-v level]
Expand Down Expand Up @@ -79,13 +80,15 @@ Optional Arguments for pcp_combine

4. The **-name list** option is a comma-separated list of output variable names which override the default choices. If specified, the number of names must match the number of variables to be written to the output file.

5. The **-vld_thresh n** option overrides the default required ratio of valid data for at each grid point for an output value to be written. The default is 1.0.
5. The **-input_thresh n** option overrides the default required ratio of valid input files. This option does not apply to the -subtract command where exactly two valid inputs are required. The default is 1.0.

6. The **-log file** option directs output and errors to the specified log file. All messages will be written to that file as well as standard out and error. Thus, users can save the messages without having to redirect the output on the command line. The default behavior is no log file.
6. The **-vld_thresh n** option overrides the default required ratio of valid data at each grid point for an output value to be written. The default is 1.0.

7. The **-v level** option indicates the desired level of verbosity. The contents of "level" will override the default setting of 2. Setting the verbosity to 0 will make the tool run with no log messages, while increasing the verbosity above 1 will increase the amount of logging.
7. The **-log file** option directs output and errors to the specified log file. All messages will be written to that file as well as standard out and error. Thus, users can save the messages without having to redirect the output on the command line. The default behavior is no log file.

8. The **-compress level** option indicates the desired level of compression (deflate level) for NetCDF variables. The valid level is between 0 and 9. The value of "level" will override the default setting of 0 from the configuration file or the environment variable MET_NC_COMPRESS. Setting the compression level to 0 will make no compression for the NetCDF output. Lower number is for fast compression and higher number is for better compression.
8. The **-v level** option indicates the desired level of verbosity. The contents of "level" will override the default setting of 2. Setting the verbosity to 0 will make the tool run with no log messages, while increasing the verbosity above 1 will increase the amount of logging.

9. The **-compress level** option indicates the desired level of compression (deflate level) for NetCDF variables. The valid level is between 0 and 9. The value of "level" will override the default setting of 0 from the configuration file or the environment variable MET_NC_COMPRESS. Setting the compression level to 0 will make no compression for the NetCDF output. Lower number is for fast compression and higher number is for better compression.

Required Arguments for the pcp_combine Sum Command
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Expand Down
21 changes: 19 additions & 2 deletions internal/test_unit/xml/unit_pcp_combine.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,19 @@
</output>
</test>

<test name="pcp_combine_sum_GRIB1_MISSING">
<exec>&MET_BIN;/pcp_combine</exec>
<param> \
20120409_00 3 20120412_15 12 \
&OUTPUT_DIR;/pcp_combine/nam_2012040900_F087_APCP12.nc \
-pcpdir &DATA_DIR_MODEL;/grib1/nam \
-input_thresh 0.75
</param>
<output>
<grid_nc>&OUTPUT_DIR;/pcp_combine/nam_2012040900_F087_APCP12.nc</grid_nc>
</output>
</test>

<test name="pcp_combine_sum_GRIB1_MULTIPLE_FIELDS">
<exec>&MET_BIN;/pcp_combine</exec>
<param> \
Expand Down Expand Up @@ -292,14 +305,17 @@
<!-- - multiple -field options -->
<!-- -->
<test name="pcp_combine_derive_MULTIPLE_FIELDS">
<exec>echo "&DATA_DIR_MODEL;/grib1/arw-fer-gep1/arw-fer-gep1_2012040912_F024.grib \
<exec>echo "MISSING \
&DATA_DIR_MODEL;/grib1/arw-fer-gep1/arw-fer-gep1_2012040912_F024.grib \
&DATA_DIR_MODEL;/grib1/arw-fer-gep5/arw-fer-gep5_2012040912_F024.grib \
&DATA_DIR_MODEL;/grib1/arw-sch-gep2/arw-sch-gep2_2012040912_F024.grib \
&DATA_DIR_MODEL;/grib1/arw-sch-gep6/arw-sch-gep6_2012040912_F024.grib \
MISSING/optional/path/to/missing/file \
&DATA_DIR_MODEL;/grib1/arw-tom-gep0/arw-tom-gep0_2012040912_F024.grib \
&DATA_DIR_MODEL;/grib1/arw-tom-gep7/arw-tom-gep7_2012040912_F024.grib \
&DATA_DIR_MODEL;/grib1/nmm-fer-gep4/nmm-fer-gep4_2012040912_F024.grib \
&DATA_DIR_MODEL;/grib1/nmm-fer-gep8/nmm-fer-gep8_2012040912_F024.grib" \
&DATA_DIR_MODEL;/grib1/nmm-fer-gep8/nmm-fer-gep8_2012040912_F024.grib \
&DATA_DIR_MODEL;/path/to/missing/file" \
> &OUTPUT_DIR;/pcp_combine/derive_file_list; \
&MET_BIN;/pcp_combine</exec>
<param> \
Expand All @@ -308,6 +324,7 @@
-field 'name="TMP"; level="Z2";' \
-field 'name="UGRD"; level="Z10";' \
-field 'name="VGRD"; level="Z10";' \
-input_thresh 0.7 \
&OUTPUT_DIR;/pcp_combine/derive_2012040912_F024_MULTIPLE_FIELDS.nc
</param>
<output>
Expand Down
Loading
Loading