Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update develop-ref after #2056, #2057, and #2060 #2059

Merged
merged 155 commits into from
Feb 20, 2022
Merged

Conversation

JohnHalleyGotway
Copy link
Collaborator

@JohnHalleyGotway JohnHalleyGotway commented Feb 19, 2022

Expected Differences

  1. Most changes are due to the addition of the new HIRA(4) output.
  2. The existing NEAREST(1) output has also changed slightly. That change is due to the random assignment of ranks for ties. Setting the random-number-generator seed produces the exact same result for multiple runs of the SAME configuration. Since this changes the configuration, the rng does NOT produce the same results as the previous configuration did. So these results make sense.

@hsoh-u I found unexpected differences in the MLCAPE output. Yes, there are new observations of MLCAPE in the output, but the existing CAPE values are also modified. I used the following commands to test:

Rscript pntnc2ascii.R nam.20210311.t00z.prepbufr.tm00.pbl_TRUTH.nc | sort | sed -r 's/ +/ /g' | sed -r 's/ $/00 /g' > nam.20210311.t00z.prepbufr.tm00.pbl_TRUTH.txt
Rscript pntnc2ascii.R nam.20210311.t00z.prepbufr.tm00.pbl_OUTPUT.nc | sed -r 's/ +/ /g' > nam.20210311.t00z.prepbufr.tm00.pbl_OUTPUT.txt
vimdiff nam.20210311.t00z.prepbufr.tm00.pbl_TRUTH.txt nam.20210311.t00z.prepbufr.tm00.pbl_OUTPUT.txt

For example, here's one example difference:
TRUTH:

ADPUPA 91165 20210311_000000 21.99 -159.34 30 CAPE NA 0 2 2046.800000 

OUTPUT:

ADPUPA 91165 20210311_000000 21.99 -159.34 30 CAPE NA 0 2 1070.800000 

Should these differences in the CAPE exist?

The differences caused by these PR's can be seen in this GHA Run and are summarized below:

(base) musial6:logs johnhg$ egrep -i "ERROR:|file1:" comp_dir.log  | egrep -B1 ERROR: | egrep file1 
file1: /data/output/met_test_truth/met_test_scripts/ensemble_stat/ensemble_stat_20100101_120000V.stat
file1: /data/output/met_test_truth/met_test_scripts/ensemble_stat/ensemble_stat_20100101_120000V_ecnt.txt
file1: /data/output/met_test_truth/met_test_scripts/ensemble_stat/ensemble_stat_20100101_120000V_orank.nc
file1: /data/output/met_test_truth/met_test_scripts/ensemble_stat/ensemble_stat_20100101_120000V_orank.txt
file1: /data/output/met_test_truth/met_test_scripts/ensemble_stat/ensemble_stat_20100101_120000V_phist.txt
file1: /data/output/met_test_truth/met_test_scripts/ensemble_stat/ensemble_stat_20100101_120000V_relp.txt
file1: /data/output/met_test_truth/met_test_scripts/ensemble_stat/ensemble_stat_20100101_120000V_rhist.txt
file1: /data/output/met_test_truth/met_test_scripts/ensemble_stat/ensemble_stat_20100101_120000V_rps.txt
file1: /data/output/met_test_truth/met_test_scripts/stat_analysis/job_aggregate_RHIST.stat
file1: /data/output/met_test_truth/met_test_scripts/stat_analysis/job_aggregate_stat_ORANK_RHIST.stat
file1: /data/output/met_test_truth/met_test_scripts/stat_analysis/stat_analysis.out
file1: /data/output/met_test_truth/pb2nc_indy/nam.20210311.t00z.prepbufr.tm00.pbl.nc
file1: /data/output/met_test_truth/pb2nc_indy/ndas.20120409.t12z.prepbufr.tm00.var_all.nc

Note that the problems listed above for PR #2057 are fixed by PR #2060.

jprestop and others added 30 commits October 26, 2021 13:08
…tead of only the filename so that the function can tell whether or not the file exists. (#1952)

Co-authored-by: Julie Prestopnik <[email protected]>
* Per issue #1761 in set_perc() adding code to get FBIAS numeric value, like 1.0 or 0.9, etc. SL

* Per issue #1761: in set_perc(), modified actual percentile calculation at end to use the extracted FBIAS numeric value (float). SL

* Per issue #1761: modified the check on the perc_thresh_freq_bias, just has to be > 0 now. SL

* Per issue #1761: cleaned up code in set_perc(). SL

* Per #1761, updates to Simple_Node::set_perc() to handle variable frequency bias amounts.
Changes include:
- Reverting the formatting of this back to how it originally was in the develop branch. In general, just match the formatting of the existing file, so as the minimize the number of difference lines.
- Add logic to adjust the percentile to be found based on the requested FBIAS value. Multiplying or dividing the percentile by the FBIAS value depends on the inequality type and whether we're bias adjusting the forecast or observation data.
- Adjust the log messages slightly.

Please be aware that I'm not totally confident in these changes. They warrant much more testing. This logic is very, very confusing.

* Per #1761, call compute_percentile() when double-checking the percentile values.

* Per #1761, remove unused variable.

* Per #1761, add warning for percentiles > 100.

* Per #1761. In set_perc(), after testing cleaned up code. SL

* Per issue #1761: adding new config file for testing dynamic FBIAS values. SL

* Per issue #1761: added new unit test for dynamic FBIAS values when running grid_stat. SL

* Per issue #1761, modified FBIAS section to indicated that the user can use dynamic values that are not 1.0. SL

* Update met/docs/Users_Guide/config_options.rst

Co-authored-by: johnhg <[email protected]>

* Update met/docs/Users_Guide/config_options.rst

Co-authored-by: johnhg <[email protected]>

* Update met/docs/Users_Guide/config_options.rst

Co-authored-by: johnhg <[email protected]>

* Update test/config/GridStatConfig_fbias_perc_thresh

Co-authored-by: johnhg <[email protected]>

* Update test/config/GridStatConfig_fbias_perc_thresh

Co-authored-by: johnhg <[email protected]>

* Update test/config/GridStatConfig_fbias_perc_thresh

Co-authored-by: johnhg <[email protected]>

* Update test/config/GridStatConfig_fbias_perc_thresh

Co-authored-by: johnhg <[email protected]>

* Per issue #1761, set nc_pairs_flag = FALSE. SL

Co-authored-by: Seth Linden <[email protected]>
Co-authored-by: John Halley Gotway <[email protected]>
…ing the logic for computing the ensemble range back to what it was previously. The new version produced very slight differences in the 6-th or 7-th decimal place when compared to previous results. There's not good reason for these changes which were caused by the order of operations in casting from doubles to floats. Reverting back to the old logic prevents diffs for anyone else downstream and is the prudent choice.
* #1949 Added CF compliant NetCDF into data IO

* #1949 Added commas

* #1948 Some corrections for typo and added the links for CF attributes

* #1948 Added Performance with NetCDF input data

* #1949 Corrected tyoe and applied Juloie's suggestions

Co-authored-by: Howard Soh <[email protected]>
…OSS. The intel compiler does not allow adjacent >> characters when defining maps.
Howard Soh and others added 24 commits February 10, 2022 15:31
…center/MET into feature_2027_grid_stat_wind_direction
* fixing section headers to be consistent with METplus #1998

* fixing section headers to be consistent with METplus #1998

* fixing section headers to be consistent with METplus #1998 missed one

* fixing section headers to be consistent with METplus #1998 try again

* fixing section headers to be consistent with METplus #1998 I had it right the first time

* fixing section headers to be consistent with METplus #1998

* fixing section headers to be consistent with METplus #1998 fixing mistake

* fixing section headers to be consistent with METplus #1998

* fixing section headers to be consistent with METplus #1998

* fixing section headers to be consistent with METplus #1998

* fixing section headers to be consistent with METplus #1998

* fixing section header underscore to dash #1998

* updating TOC vs ref 1998

* updating TOC vs ref 1998 completed

* trying to fix link #1998

* trying to fix link adding reference back in #1998

* updating TOC again underscore vs dash #1998

* updating TOC again underscore vs dash #1998

* updating TOC vs ref 1998 try

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998 take 2

* standardizing TOC sections #1998 take 3

* re-standardizing TOC sections #1998

* re-standardizing TOC sections #1998

* re-standardizing TOC sections #1998

* re-standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998

* updating questions into the TOC.  test #1998

* updating questions into the TOC. #1998

* standardizing TOC sections #1998

* standardizing TOC sections #1998 fixing typo

* standardizing TOC sections #1998 fixing typo

* standardizing TOC sections #1998 fixing typo

* standardizing TOC sections #1998 fixing typo

* standardizing TOC sections #1998 fixing typo

* standardizing TOC sections #1998 fixing typo

* cleaning up questions. removing section title from questions.

* adding a period #1989.

* adding the line breaks back in to match other formatting within MET #1989.

* Changed some "^^^" to "----"

* Changed "###" to "***"

Co-authored-by: jprestop <[email protected]>
#2047 Removed the debug message
Removing variable that was set but never used because SonarQube might complain about that, like Fortify does.
Co-authored-by: Julie Prestopnik <[email protected]>
…rection

Feature 2027 grid stat wind direction
…ar entry should really be obs_bufr_map and not commented out.
#1824 ci-run-test Reset itype to 1 for regular CAPE
@JohnHalleyGotway JohnHalleyGotway changed the title Update develop-ref after #2056 and #2057 Update develop-ref after #2056, #2057, and #2060 Feb 20, 2022
@JohnHalleyGotway JohnHalleyGotway marked this pull request as ready for review February 20, 2022 04:38
@JohnHalleyGotway JohnHalleyGotway added this to the MET 10.1.0 milestone Feb 20, 2022
@JohnHalleyGotway JohnHalleyGotway merged commit e9499f1 into develop-ref Feb 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants