Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update develop-ref after #2307, #2314, #2315, #2316, and #2317 #2324

Merged
merged 427 commits into from
Oct 30, 2022

Conversation

JohnHalleyGotway
Copy link
Collaborator

Expected Differences

Updating develop-ref after recent pull requests changed the expected output. The differences described below are based on this GHA run for the MET-11.0.0-beta4 pull request #2323.

There are 6 new output files generated by this run:

ERROR: folder /data/output/met_test_truth missing 6 files
  1. PR Feature #2068 ioda2nc v2.0 #2307 for issue Enhance IODA2NC to support IODA v2.0 format #2068 adds 2 new output files from ioda2nc:
    ioda2nc/2021081612_sonde_small_sid.nc 
    ioda2nc/jopa_satwind_20210701T1200Z_int_datetime.nc 

Also, the output file size of 31 NetCDF files now differs by > 1%:

egrep -i "ERROR: NetCDF file size|file1:" comp_dir.log | egrep -B 1 "ERROR" | egrep file1 | wc -l
31

Here's the ERROR message:

ERROR: NetCDF file size difference exceeds 1 %

This is explained by switching from METbaseimage v1.0 to v1.1 which changes the version of the NetCDF library used.

  1. PR Bugfix #2306 ascii2nc airnow hourly #2314 for issues Fix ascii2nc_airnow_hourly test in unit_ascii2nc.xml #2306 fixes a bug in the airnow output of ascii2nc:
file1: /data/output/met_test_truth/ascii2nc/airnow/HourlyData_20220312.nc
ERROR: NetCDF headers differ:
  1. PR Feature #392 tcdiag_line_type #2315 for issues Enhance TC-Pairs to read hurricane model diagnostic files (e.g. SHIPS) and TC-Stat to filter the new data #392 adds 1 new output file from tc_pairs and 2 new output files from tc_stat:
    tc_pairs/al092022_20220926_DIAGNOSTICS.tcst 
    tc_stat/DIAGNOSTICS_filter_match_points.tcst 
    tc_stat/DIAGNOSTICS_stat.out 
  1. PR Feature 2232 refine grid diag #2316 for issue Refine Grid-Diag output variable names when specifying two input data sources #2232 adds 1 new output file from grid_diag:
    grid_diag/grid_diag_APCP_06_VARN.nc 
  1. PR Feature #2058 bias_ratio #2317 for issues Add new bias ratio statistic to the ECNT line type from Ensemble-Stat and for HiRA #2058 adds new columns to the ECNT line type which trigger diffs in 23 files:
egrep -i "ERROR:|file1:" comp_dir.log  | egrep -v "NetCDF file size" | egrep -B 1 "ERROR:" | egrep file1 | wc -l
23

Spot checking some of these file diffs, the only diffs I see are the addition of 5 new columns of data.

Updating develop-ref to get past these 5 sources of difference.

JohnHalleyGotway and others added 30 commits March 3, 2022 11:52
…cking the length of config_file instead of out_file. This became obvious when running gen_ens_prod without the -out option. That run segfaulted because it tried to create an output file using an empty string. (#2087)
Feature 1824 pb2nc log message for mlcape
* for #1275, fix issue with more than 1000 object for mode, ci-run-unit

* Per #1275, just deleting stale, commented-out code.

Co-authored-by: Randy Bullock <[email protected]>
Co-authored-by: davidfillmore <[email protected]>
Co-authored-by: rgbullock <[email protected]>
Co-authored-by: John Halley Gotway <[email protected]>
…ific input data if running tests on main_v branch
* Updating configuration and modulefiles

* Removed jet files
JohnHalleyGotway and others added 28 commits September 20, 2022 23:31
… seneca changes the order of vx_grid semilatlon slightly. We probably manually editted that file instead of running bootstrap to regenerate it.
Co-authored-by: George McCabe <[email protected]>
* Per #2227 changes in this commit resolve all errors from removing 'using namespace std' from all header files in the src/basic directory

* Attempt to resolve errors in GitHub actions from removing 'using namepsace std' from all src/basic/ libraries, plus removal from src/libcode/vx_gnomon/gnomon.h and src/libcode/vx_nc_util/nc_utils.h

* Attempt to fix GHA errors with compilation after removal of 'using namespace std'; locally compiles fine

* Per #2227, attempting to fix GHA compilation; Compiltion on seneca works fine

* Per #2227, attempt to resolve GHA compilation issues; seneca compilation works fine

* Per #2227, attempt to resolve GHA compilation issues; seneca compilation works fine

* Per #2227, removing namespace from vx_series_data library

* Per #2227, removing namespace std from vx_shapedata library

* Per #2227, removing namespace std from vx_data2d_grib2 and vx_data2d_grib libraries

* Per #2227, removing namespace std from vx_statistics library

* Per #2227, removing namespace std from src/tools/tc_utils

* Per #2227, removed namespace std from /src/tools/core header files

* Per #2227, clean up and continued work

* Per #2227, changes to remove namespace std and netCDF from header files

* Per #2227, resolve errors in GitHub Actions build

* Per #2227, resolve new errors in GitHub Actions build

* Per #2227, resolve new errors in GitHub Actions build

* Per #2227, resolve new errors in GitHub Actions build

* Per #2227, realign variables

* Per #2227, updating comment

* Per #2227, updating comment

* Per #2227, realign variables

* Per #2227, realign variables

* Per #2227, realign variables

* Per #2227, updating comment

* Update src/basic/vx_config/config.tab.cc

Co-authored-by: johnhg <[email protected]>

Co-authored-by: Julie Prestopnik <[email protected]>
Co-authored-by: johnhg <[email protected]>
Changes for #2297 included a small typo that I'm fixing directly in the develop branch.
A final hotfix to the develop branch to get the build_docker_trigger_metplus.yml workflow working again. I tested on feature_2297_gha branch to confirm that no double-quotes are actually needed.
Co-authored-by: Julie Prestopnik <[email protected]>
Co-authored-by: Seth Linden <[email protected]>
Co-authored-by: John Halley Gotway <[email protected]>
Clean up Python Embedding scripts
Co-authored-by: Dave Albo <[email protected]>
Co-authored-by: MET Tools Test Account <[email protected]>
Co-authored-by: Seth Linden <[email protected]>
Co-authored-by: John Halley Gotway <[email protected]>
Co-authored-by: MET Tools Test Account <[email protected]>
Co-authored-by: Howard Soh <[email protected]>
Co-authored-by: John Halley Gotway <[email protected]>
Co-authored-by: MET Tools Test Account <[email protected]>
@JohnHalleyGotway JohnHalleyGotway added this to the MET 11.0.0 milestone Oct 30, 2022
@JohnHalleyGotway JohnHalleyGotway merged commit b70b5e7 into develop-ref Oct 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Development

Successfully merging this pull request may close these issues.