Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update develop-ref after #2010 and #2029 attempt 3 #2033

Merged
merged 109 commits into from
Jan 28, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
109 commits
Select commit Hold shift + click to select a range
9437447
Per #1906, modify code to pass entire path to make_temp_file_name ins…
jprestop Oct 26, 2021
8c446ff
Feature 1761 percent thresh (#1956)
sethlinden Nov 3, 2021
d60924c
Feature 1905 ens_ctrl (#1955)
JohnHalleyGotway Nov 3, 2021
3b13ce1
Hotfix after merging changing for #1761. Updating the list of expecte…
JohnHalleyGotway Nov 3, 2021
5131042
Per #1905, committing a hotfix directly to the develop branch. Revert…
JohnHalleyGotway Nov 3, 2021
4ff28d1
Feature 1957 ascii2nc_python (#1958)
JohnHalleyGotway Nov 4, 2021
aee6269
Feature 1949 cf netcdf documentaton (#1951)
hsoh-u Nov 15, 2021
867360f
Feature 1968 ens_ctrl (#1969)
JohnHalleyGotway Nov 15, 2021
0990061
Feature 1809 gen prob (#1967)
JohnHalleyGotway Nov 16, 2021
1663bb6
Merge branch 'develop-ref' into develop
JohnHalleyGotway Nov 16, 2021
13996c2
Feature 1970 v10.1.0-beta4 (#1973)
JohnHalleyGotway Nov 16, 2021
dae9db7
Fix tiny typo in plot_data_plane usage statement.
JohnHalleyGotway Nov 17, 2021
9bd9946
Hotfix for the develop branch to get met-10.1.0-beta4 compiling on WC…
JohnHalleyGotway Nov 17, 2021
e0b659d
Updating the beta4 release date from 11/16 to 11/17 since the beta4 r…
JohnHalleyGotway Nov 17, 2021
817d9db
Update the MET PR template to list expected changes up front.
JohnHalleyGotway Nov 19, 2021
4e28ae7
Bugfix 1976 develop cdist (#1979)
JohnHalleyGotway Nov 22, 2021
6d16e23
Merge branch 'develop-ref' into develop
JohnHalleyGotway Nov 23, 2021
39a5233
#1936 Excludes precip3hr, precip6hr, precip12hr, and precip10min from…
Nov 29, 2021
c9434e8
Per #1985, correcting typo found while creating V10.0.1 in the develo…
JohnHalleyGotway Dec 1, 2021
84f8c7f
Per #1985, VERY minor change to fix alignment of titles in Point-Stat…
JohnHalleyGotway Dec 1, 2021
d35190e
#1936 Added an unit test for newer MESONET file
Dec 1, 2021
f81d250
Merge pull request #1984 from dtcenter/feature_1936_madis_nc2
hsoh-u Dec 2, 2021
8c29f09
Feature 1989 sort (#1990)
JohnHalleyGotway Dec 13, 2021
b93f4ea
Feature 1991 VCNT (#1992)
JohnHalleyGotway Dec 13, 2021
49fb555
Feature 1993 grid_mask (#1994)
JohnHalleyGotway Dec 13, 2021
dd0a68b
#1844 Added vx_pointdata_python
Dec 28, 2021
2b61506
#1844 Added vx_pointdata_python to PYTHON_LIBS & make file for vx_poi…
Dec 28, 2021
b4a4e18
#1844 Added vx_pointdata_python to SUBDIRS
Dec 28, 2021
ba9f81e
#1844 Initial release
Dec 28, 2021
abef2b7
#1844 Added met_point_data.cc & met_point_data.h
Dec 28, 2021
6c36d79
#1844 NcHeaderData is renamed to MetPointHeader and moved to met_poin…
Dec 28, 2021
3f0de5e
#1844 NcPointObsData is derived from MetPointObsData. Many methods ar…
Dec 28, 2021
6c50d50
#1844 Moved varianbles and methods to the base class MetPointData
Dec 28, 2021
0d7b731
#1844 override the obs_data pointer to the derived class
Dec 28, 2021
b053f71
#1844 Added pyobject_as_bool & pyobject_as_string_array
Dec 28, 2021
0ecea6e
#1844 Cleanup include statements and addpointdata_python.h if python …
Dec 28, 2021
e397fa1
#18443 Support python embedding
Dec 28, 2021
315d3b4
#1844 Initial release
Dec 28, 2021
95a65ed
#1844 Make buf_size const
Dec 29, 2021
e900334
Add GitHub Actions workflow to trigger METplus testing workflow (#2002)
georgemccabe Jan 5, 2022
1c981f4
changed names of inputs to send to METplus to match changes to METplu…
georgemccabe Jan 5, 2022
0273cf1
#1965 Excludes the duplicated variable names from multiple input files
Jan 7, 2022
ab1199b
#1965 Processed with the raw variable names and update them when the …
Jan 11, 2022
d5cc7b1
#1965 Added unit test ioda2nc_same_input
Jan 11, 2022
e48c5ff
#1965 Processed with the raw variable names and update them when the …
Jan 11, 2022
5617aa2
#1965 Added unit test ioda2nc_same_input
Jan 11, 2022
ee76143
#1965 initialize var_idx
hsoh-u Jan 12, 2022
1e97085
Merge pull request #2006 from dtcenter/feature_1965_ioda2nc_same_input
hsoh-u Jan 12, 2022
acbb7b9
Update the development environment for seneca to add /usr/local/nco/b…
Jan 12, 2022
717dd17
Merge branch 'develop' of https://github.com/dtcenter/MET into develop
JohnHalleyGotway Jan 12, 2022
58988bf
send email address of user who triggered event to METplus workflow as…
georgemccabe Jan 12, 2022
5632c5c
Merge branch 'develop' of github.com:dtcenter/MET into develop
georgemccabe Jan 12, 2022
b267883
Fixup the Rscript diffing logic to support running the nightly build …
JohnHalleyGotway Jan 12, 2022
d7eb8e4
Merge branch 'develop' of https://github.com/dtcenter/MET into develop
JohnHalleyGotway Jan 12, 2022
96536f5
No real changes here. Just formatting
Jan 12, 2022
fa41760
Feature 1974 message_type_group_map (#1999)
hsoh-u Jan 12, 2022
551f92b
Feature 1996 uninitialized variables (#2004)
hsoh-u Jan 12, 2022
39d7e6f
Merge remote-tracking branch 'origin/develop' into feature_1844_pytho…
Jan 12, 2022
dbc7d10
Feature 1695 ensemble single file (gen_ens_prod) (#2001)
georgemccabe Jan 12, 2022
be7910e
Feature 1965 NB faile with time summary by ioda2nc (#2008)
hsoh-u Jan 12, 2022
1e13dea
Feature 1810 shapes (#2005)
JohnHalleyGotway Jan 13, 2022
edd61fd
#1844 Added log message for use_var_id
Jan 13, 2022
6cae6b5
#1844 Get use_var_id for python embedding
Jan 13, 2022
aaa1010
#1844 Initial release
Jan 13, 2022
adf4928
#1844 Added met_point_obs.py and read_met_point_obs.py
Jan 13, 2022
0640d8d
#1844 Added 4 unit test for python embedding of MET point data
Jan 13, 2022
9483487
Merge remote-tracking branch 'origin/develop' into feature_1844_pytho…
Jan 13, 2022
37f4f32
More changes to test_util.R to account for differences between 4.7.0 …
JohnHalleyGotway Jan 13, 2022
36761b6
Fix merge conflict
JohnHalleyGotway Jan 13, 2022
4f57edd
#1844 Added python embedding for point observation data
Jan 13, 2022
27925d8
Merge remote-tracking branch 'origin/develop' into feature_1844_pytho…
Jan 13, 2022
de81526
Feature 1926 gridstat openmp (#1977)
mo-mglover Jan 13, 2022
e96a211
feature 1695 ensemble single file (ensemble_stat) (#2007)
georgemccabe Jan 14, 2022
032456b
Committing directly to the develop branch. Removing many, many instan…
JohnHalleyGotway Jan 14, 2022
ee4a3a4
feature 2011 v10.1.0-beta5 (#2014)
JohnHalleyGotway Jan 15, 2022
18ccf3a
feature 1695 fix issues with ensemble changes (#2012)
georgemccabe Jan 15, 2022
634806e
Merge branch 'develop-ref' into develop
JohnHalleyGotway Jan 15, 2022
e9df2fc
Hotfix for #1695 committed directly to the develop branch. The new En…
JohnHalleyGotway Jan 16, 2022
e75fe46
Merge branch 'develop-ref' into develop
JohnHalleyGotway Jan 17, 2022
65539e1
Adding George to email list for the nightly build.
JohnHalleyGotway Jan 18, 2022
ee621eb
Merge branch 'develop' into feature_1844_python_embedding
JohnHalleyGotway Jan 18, 2022
7c18231
Fix the links for the met-10.1.0-beta5 release notes.
JohnHalleyGotway Jan 20, 2022
3bd3cb3
Merge remote-tracking branch 'origin/develop' into feature_1844_pytho…
Jan 20, 2022
b8e0de3
#1844 Make met_point_obs as abstract class
Jan 21, 2022
29d479f
#1844 correctedb for loop end condition on processing obs bdata
Jan 21, 2022
333419c
Feature 1546 unit_tests (#2021)
JohnHalleyGotway Jan 24, 2022
b177c3b
#2020 Added SonarQube related varibales
Jan 25, 2022
11daa46
#2020 Initial release
Jan 25, 2022
89642fc
#2015 Avoid the repeasted debug message if derived varibales are disa…
Jan 25, 2022
6b9b411
#1996 Initialize right and left
Jan 25, 2022
b606312
#1966 Call clear() instead of reset memory for Header variable
Jan 25, 2022
4142c48
#1966 Make sure the levels from variable does not exceed the maxLevel
Jan 25, 2022
c4f5a1b
#1966 Removed unreachable codes
Jan 25, 2022
4226cbe
#1966 Do not write into NetcDF if empty data
Jan 25, 2022
dd9c46c
Merge branch 'develop' into feature_1844_python_embedding
JohnHalleyGotway Jan 25, 2022
7aaddba
Merge pull request #2010 from dtcenter/feature_1844_python_embedding
hsoh-u Jan 26, 2022
587b936
#2015 Corrected "retained or derived" count
Jan 27, 2022
cfb4759
Merge pull request #2024 from dtcenter/feature_2020_run_sonarqube
hsoh-u Jan 27, 2022
80f79fd
Merge pull request #2026 from dtcenter/feature_2015_pb2nc_debug_message
hsoh-u Jan 27, 2022
3097278
Feature 1546 CI testing (#2029)
georgemccabe Jan 27, 2022
d9447e9
Merge branch 'develop-ref' into develop
JohnHalleyGotway Jan 27, 2022
42ca71a
fixed broken workflow by setting environment variable expected for do…
georgemccabe Jan 27, 2022
5939357
add missing docker tag from push command
georgemccabe Jan 27, 2022
1e7551f
added correct docker tag value
georgemccabe Jan 27, 2022
afe0ad4
fixed incorrect truth data version for updating -ref reference data
georgemccabe Jan 27, 2022
6e1e209
Merge branch 'develop-ref' into develop
georgemccabe Jan 27, 2022
555494b
Updating develop with changes to the unit tests names. Renaming unit_…
JohnHalleyGotway Jan 28, 2022
ece4c3a
fixed directory to copy truth data into -- copy command was copying t…
georgemccabe Jan 28, 2022
afdf9db
git push origin develop0;136;0cMerge branch 'develop-ref' into develop
georgemccabe Jan 28, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/jobs/Dockerfile.truth
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
FROM centos:7
MAINTAINER George McCabe <[email protected]>

ENV OUTPUT_DIR /data/output
ENV OUTPUT_DIR /data/output/met_test_truth
RUN mkdir -p ${OUTPUT_DIR}

ARG TRUTH_DIR
Expand All @@ -11,7 +11,7 @@ COPY ${TRUTH_DIR} ${OUTPUT_DIR}/
ARG TRUTH_DIR

# Define the volume mount point
VOLUME ${OUTPUT_DIR}/${TRUTH_DIR}
VOLUME ${OUTPUT_DIR}

USER root
CMD ["true"]
58 changes: 29 additions & 29 deletions .github/workflows/unit_tests.yml → .github/workflows/testing.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: Unit Tests
name: Testing

# Compile MET and run unit tests
# for pull requests into develop branch
Expand Down Expand Up @@ -82,8 +82,8 @@ jobs:
path: ${{ runner.workspace }}/logs
if-no-files-found: ignore

unit_tests_1a:
name: MET Unit Tests 1a
unit_1a:
name: Unit 1a
runs-on: ubuntu-latest
needs: [job_control, compile]
if: ${{ needs.job_control.outputs.run_unit_tests == 'true' }}
Expand All @@ -106,7 +106,7 @@ jobs:
- name: Upload output as artifact
uses: actions/upload-artifact@v2
with:
name: unit_tests_1a
name: unit_1a
path: ${{ runner.workspace }}/output

- name: Upload logs as artifact
Expand All @@ -117,8 +117,8 @@ jobs:
path: ${{ runner.workspace }}/logs
if-no-files-found: ignore

unit_tests_1b:
name: MET Unit Tests 1b
unit_1b:
name: Unit 1b
runs-on: ubuntu-latest
needs: [job_control, compile]
if: ${{ needs.job_control.outputs.run_unit_tests == 'true' }}
Expand All @@ -141,7 +141,7 @@ jobs:
- name: Upload output as artifact
uses: actions/upload-artifact@v2
with:
name: unit_tests_1b
name: unit_1b
path: ${{ runner.workspace }}/output

- name: Upload logs as artifact
Expand All @@ -152,8 +152,8 @@ jobs:
path: ${{ runner.workspace }}/logs
if-no-files-found: ignore

unit_tests_ref_config_leads:
name: MET Unit Tests ref_config leads
unit_rc_leads:
name: Unit RC leads
runs-on: ubuntu-latest
needs: [job_control, compile]
if: ${{ needs.job_control.outputs.run_unit_tests == 'true' }}
Expand All @@ -177,7 +177,7 @@ jobs:
- name: Upload output as artifact
uses: actions/upload-artifact@v2
with:
name: unit_tests_ref_config_leads
name: unit_rc_leads
path: ${{ runner.workspace }}/output

- name: Upload logs as artifact
Expand All @@ -188,10 +188,10 @@ jobs:
path: ${{ runner.workspace }}/logs
if-no-files-found: ignore

unit_tests_ref_config:
name: MET Unit Tests ref_config
unit_rc:
name: Unit RC
runs-on: ubuntu-latest
needs: [job_control, unit_tests_ref_config_leads]
needs: [job_control, unit_rc_leads]
if: ${{ needs.job_control.outputs.run_unit_tests == 'true' }}
strategy:
matrix:
Expand All @@ -204,7 +204,7 @@ jobs:
- name: Download ref_config_leads output from artifact
uses: actions/download-artifact@v2
with:
name: unit_tests_ref_config_leads
name: unit_rc_leads
path: ${{ runner.workspace }}/output

- name: Run Unit Tests in Docker
Expand All @@ -217,7 +217,7 @@ jobs:
- name: Upload output as artifact
uses: actions/upload-artifact@v2
with:
name: unit_tests_ref_config
name: unit_rc
path: ${{ runner.workspace }}/output

- name: Upload logs as artifact
Expand All @@ -228,10 +228,10 @@ jobs:
path: ${{ runner.workspace }}/logs
if-no-files-found: ignore

unit_tests_2a:
name: MET Unit Tests 2a
unit_2a:
name: Unit 2a
runs-on: ubuntu-latest
needs: [job_control, unit_tests_1a]
needs: [job_control, unit_1a]
if: ${{ needs.job_control.outputs.run_unit_tests == 'true' }}
strategy:
matrix:
Expand All @@ -247,7 +247,7 @@ jobs:
- name: Download 1a output from artifact
uses: actions/download-artifact@v2
with:
name: unit_tests_1a
name: unit_1a
path: ${{ runner.workspace }}/output

- name: Run Unit Tests in Docker
Expand All @@ -260,7 +260,7 @@ jobs:
- name: Upload output as artifact
uses: actions/upload-artifact@v2
with:
name: unit_tests_2a
name: unit_2a
path: ${{ runner.workspace }}/output

- name: Upload logs as artifact
Expand All @@ -271,10 +271,10 @@ jobs:
path: ${{ runner.workspace }}/logs
if-no-files-found: ignore

unit_tests_2b:
name: MET Unit Tests 2b
unit_2b:
name: Unit 2b
runs-on: ubuntu-latest
needs: [job_control, unit_tests_1a]
needs: [job_control, unit_1a]
if: ${{ needs.job_control.outputs.run_unit_tests == 'true' }}
strategy:
matrix:
Expand All @@ -290,7 +290,7 @@ jobs:
- name: Download 1a output from artifact
uses: actions/download-artifact@v2
with:
name: unit_tests_1a
name: unit_1a
path: ${{ runner.workspace }}/output

- name: Run Unit Tests in Docker
Expand All @@ -303,7 +303,7 @@ jobs:
- name: Upload output as artifact
uses: actions/upload-artifact@v2
with:
name: unit_tests_2b
name: unit_2b
path: ${{ runner.workspace }}/output

- name: Upload logs as artifact
Expand All @@ -317,7 +317,7 @@ jobs:
run_diffs:
name: Check for Differences
runs-on: ubuntu-latest
needs: [job_control, unit_tests_1b, unit_tests_2a, unit_tests_2b, unit_tests_ref_config]
needs: [job_control, unit_1b, unit_2a, unit_2b, unit_rc]
if: ${{ needs.job_control.outputs.run_diff == 'true' }}
steps:
- name: Download data from previous jobs
Expand All @@ -326,7 +326,7 @@ jobs:
- name: Copy test output into single directory
run: |
mkdir ${RUNNER_WORKSPACE}/output
cp -r unit_tests_*/* ${RUNNER_WORKSPACE}/output/
cp -r unit_*/* ${RUNNER_WORKSPACE}/output/

- uses: actions/checkout@v2

Expand Down Expand Up @@ -356,7 +356,7 @@ jobs:
update_truth:
name: Update Truth Data
runs-on: ubuntu-latest
needs: [job_control, unit_tests_1b, unit_tests_2a, unit_tests_2b, unit_tests_ref_config]
needs: [job_control, unit_1b, unit_2a, unit_2b, unit_rc]
if: ${{ needs.job_control.outputs.run_update_truth == 'true' }}
steps:
- uses: actions/checkout@v2
Expand All @@ -367,7 +367,7 @@ jobs:
- name: Copy test output into single directory
run: |
mkdir ${RUNNER_WORKSPACE}/met_test_truth
cp -r unit_tests_*/* ${RUNNER_WORKSPACE}/met_test_truth/
cp -r unit_*/* ${RUNNER_WORKSPACE}/met_test_truth/

- name: Create Docker Data Volume
run: .github/jobs/create_docker_truth.sh
Expand Down