120 m and 250m meshes running with NEMSpy #86

saeed-moghimi-noaa · 2021-04-21T14:22:54Z

No description provided.

ghost · 2021-04-26T20:04:00Z

here's an initialization command for TPXO + ATMESH + WW3DATA:

initialize_adcirc \
  --output-directory run_nemsadcirc_besttrack_hsofs_250m \
  --mesh-directory /scratch2/COASTAL/coastal/save/shared/models/meshes/hsofs/250m/v1.0 \
  --modeled-start-time 20121022T060000 \
  --modeled-duration 04:05:00:00 \
  --modeled-timestep 00:00:02 \
  --nems-interval 3600 \
  --tidal-spinup-duration 12:06:00:00 \
  --platform HERA \
  --adcirc-processors 600 \
  --adcirc-executable /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/padcirc \
  --adcprep-executable /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/adcprep \
  --modulefile /scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/modulefiles/envmodules_intel.hera \
  --job-duration 06:00:00 \
  --forcings tidal,atmesh,ww3data \
  --tidal-source TPXO \
  --tidal-path /scratch2/COASTAL/coastal/save/shared/models/forcings/tides/h_tpxo9.v1.nc \
  --atmesh-path /scratch2/COASTAL/coastal/save/shared/models/forcings/hsofs/250m/v1.0/sandy/Wind_HWRF_SANDY_Nov2018_ExtendedSmoothT.nc \
  --ww3data-path /scratch2/COASTAL/coastal/save/shared/models/forcings/hsofs/250m/v1.0/sandy/ww3.HWRF.NOV2018.2012_sxy.nc

ghost · 2021-05-12T17:08:59Z

NEMS + ADCIRC + BestTrack + WW3DATA

it looks like, for NEMS+ADCIRC, the spinup ran completely but the hotstart failed at the adcprep stage

cd /scratch2/COASTAL/coastal/save/shared/working/zach/nems_adcirc/run_20210512_hsofs_120m_subsetflo_besttrack_florence

hotstart `ADCIRC_SETUP.log`

cat runs/besttrack_1/ADCIRC_SETUP.err.log

forrtl: severe (59): list-directed I/O syntax error, unit 15, file /scratch2/COASTAL/coastal/save/shared/working/zach/nems_adcirc/run_20210512_hsofs_120m_subsetflo_besttrack_florence/runs/besttrack_1/fort.15
Image              PC                Routine            Line        Source
adcprep            0000000000697ECE  Unknown               Unknown  Unknown
adcprep            00000000006CEC60  Unknown               Unknown  Unknown
adcprep            00000000006CCFC2  Unknown               Unknown  Unknown
adcprep            000000000040E871  presizes_mp_sizeu        1068  presizes.F
adcprep            000000000042D06F  prepinput_                436  adcprep.F
adcprep            000000000042BB2B  MAIN__                    239  adcprep.F
adcprep            000000000040B65E  Unknown               Unknown  Unknown
libc-2.17.so       00002B66A3BFD555  __libc_start_main     Unknown  Unknown
adcprep            000000000040B569  Unknown               Unknown  Unknown
srun: error: h8c22: task 0: Exited with exit code 59
srun: launch/slurm: _step_signal: Terminating StepId=18853575.1

differences between spinup and hotstart `fort.15`

diff spinup/fort.15 runs/besttrack_1/fort.15

1c1
< created on 2021-05-12 17:37                                     ! RUNDES                              - 32 CHARACTER ALPHANUMERIC RUN DESCRIPTION
---
> created on 2021-05-12 17:39                                     ! RUNDES                              - 32 CHARACTER ALPHANUMERIC RUN DESCRIPTION
6c6
< 0                                                               ! IHOT                                - HOT START PARAMETER
---
> 567                                                             ! IHOT                                - HOT START PARAMETER
21,22c21,22
< 0                                                               ! NWS                                 - WIND STRESS AND BAROMETRIC PRESSURE OPTION PARAMETER
< 1                                                               ! NRAMP                               - RAMP FUNCTION OPTION
---
> 520                                                             ! NWS                                 - WIND STRESS AND BAROMETRIC PRESSURE OPTION PARAMETER
> 8                                                               ! NRAMP                               - RAMP FUNCTION OPTION
28,29c28,30
< 14                                                              ! RNDAY                               - TOTAL LENGTH OF SIMULATION (IN DAYS)
< 14                                                              ! DRAMP                               - DURATION OF RAMP FUNCTION (IN DAYS)
---
> 2018 09 11 06 06 0.9 1 7                                        ! WTIMINC RSTIMINC                    - meteorological data time increment, wave forcing increment
> 20                                                              ! RNDAY                               - TOTAL LENGTH OF SIMULATION (IN DAYS)
> 14.000 0.000 0.000 0.000 14.000 14.000 1.000 0.000 14.000       ! DRAMP                               - DURATION OF RAMP FUNCTION (IN DAYS)
4930c4931
< -5 0 14 514                                                     ! NOUTE TOUTSE TOUTFE NSPOOLE         - ELEV STATION OUTPUT INFO (UNIT 61)
---
> -5 0 20 51                                                      ! NOUTE TOUTSE TOUTFE NSPOOLE         - ELEV STATION OUTPUT INFO (UNIT 61)
5186c5187
< -5 0 14 514                                                     ! NOUTV TOUTSV TOUTFV NSPOOLV         - VELOCITY STATION OUTPUT INFO (UNIT 62)
---
> -5 0 20 51                                                      ! NOUTV TOUTSV TOUTFV NSPOOLV         - VELOCITY STATION OUTPUT INFO (UNIT 62)
5188,5189c5189,5193
< -5 0.000000 14.000000 514                                       ! NOUTGE TOUTSGE TOUTFGE NSPOOLGE     - GLOBAL ELEVATION OUTPUT INFO (UNIT 63)
< -5 0.000000 0.000000 514                                        ! NOUTGV TOUTSGV TOUTFGV NSPOOLGV     - GLOBAL VELOCITY OUTPUT INFO (UNIT 64)
---
> 0 0 0 0                                                         ! NOUTM TOUTSM TOUTFM NSPOOLM         - METEOROLOGICAL STATION OUTPUT INFO (UNITS 71/72)
> 0                                                               ! NSTAM                               - TOTAL NUMBER OF METEOROLOGICAL RECORDING STATIONS
> -5 0.000000 20.000000 514                                       ! NOUTGE TOUTSGE TOUTFGE NSPOOLGE     - GLOBAL ELEVATION OUTPUT INFO (UNIT 63)
> -5 0.000000 20.000000 514                                       ! NOUTGV TOUTSGV TOUTFGV NSPOOLGV     - GLOBAL VELOCITY OUTPUT INFO (UNIT 64)
> 0 0.000000 0.000000 0                                           ! NOUTGM TOUTSGM TOUTFGM NSPOOLGM     - GLOBAL METEOROLOGICAL OUTPUT INFO
5193c5197
< 5 172800                                                        ! NHSTAR NHSINC                       - HOT START FILE GENERATION PARAMETERS
---
> 0 0                                                             ! NHSTAR NHSINC                       - HOT START FILE GENERATION PARAMETERS
5204a5209
> &SWANOutputControl SWAN_OutputHS=False, SWAN_OutputDIR=False, SWAN_OutputTM01=False, SWAN_OutputTPS=False, SWAN_OutputWIND=False, SWAN_OutputTM02=False, SWAN_OutputTMM10=False \

ghost · 2021-05-12T17:19:34Z

cat configure_adcirc.json

{
  "adcirc_executable_path": "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/NEMS/exe/NEMS.x",
  "adcprep_executable_path": "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/ADCIRC/work/adcprep",
  "aswip_executable_path": "/scratch2/COASTAL/coastal/save/shared/repositories/adcirc-cg/work/aswip",
  "modeled_start_time": "2018-09-11 06:00:00",
  "modeled_end_time": "2018-09-17 06:00:00",
  "modeled_timestep": 7.0,
  "tidal_spinup_duration": "14:00:00:00",
  "fort_13_path": "/scratch2/COASTAL/coastal/save/shared/models/meshes/hsofs/120m/Subsetted_Florence2018_Test/fort.13",
  "fort_14_path": "/scratch2/COASTAL/coastal/save/shared/models/meshes/hsofs/120m/Subsetted_Florence2018_Test/fort.14",
  "tidal_spinup_timestep": 7.0,
  "source_filename": "/scratch2/COASTAL/coastal/save/shared/repositories/ADC-WW3-NWM-NEMS/modulefiles/envmodules_intel.hera",
  "use_original_mesh": false,
  "output_surface": true,
  "surface_output_interval": 3600.0,
  "output_stations": true,
  "stations_file_path": "/scratch2/COASTAL/coastal/save/shared/models/meshes/hsofs/120m/v2.2_20210315/stations.txt",
  "stations_output_interval": 360.0,
  "output_spinup": true,
  "output_elevations": true,
  "output_velocities": true,
  "output_concentrations": false,
  "output_meteorological_factors": false,
  "processors": 600,
  "nems_parameters": {},
  "attributes": {
    ...
    "gwce_solution_scheme": "explicit",
    ...
    "smagorinsky": true,
    ...
  }
}

ghost · 2021-05-12T18:32:04Z

difference between ADCIRC-only hotstart and NEMS+ADCIRC hotstart `fort.15`

diff adcirc/run_20210512_hsofs_120m_subsetflo_besttrack_florence_longerspinup/runs/unperturbed/fort.15 nems_adcirc/run_20210512_hsofs_120m_subsetflo_besttrack_florence/runs/besttrack_1/fort.15

1c1
< created on 2021-05-12 14:49                                     ! RUNDES                              - 32 CHARACTER ALPHANUMERIC RUN DESCRIPTION
---
> created on 2021-05-12 17:39                                     ! RUNDES                              - 32 CHARACTER ALPHANUMERIC RUN DESCRIPTION
8c8
< 511113                                                          ! IM                                  - MODEL SELECTION PARAMETER
---
> 511112                                                          ! IM                                  - MODEL SELECTION PARAMETER
21c21
< 20                                                              ! NWS                                 - WIND STRESS AND BAROMETRIC PRESSURE OPTION PARAMETER
---
> 520                                                             ! NWS                                 - WIND STRESS AND BAROMETRIC PRESSURE OPTION PARAMETER
28,31c28,31
< 2018 09 11 06 06 0.9 1                                          ! WTIMINC                             - meteorological data time increment
< 36                                                              ! RNDAY                               - TOTAL LENGTH OF SIMULATION (IN DAYS)
< 30.000 0.000 0.000 0.000 30.000 30.000 1.000 0.000 30.000       ! DRAMP                               - DURATION OF RAMP FUNCTION (IN DAYS)
< 0.5 0.5 0                                                       ! A00 B00 C00                         - TIME WEIGHTING FACTORS FOR THE GWCE EQUATION
---
> 2018 09 11 06 06 0.9 1 7                                        ! WTIMINC RSTIMINC                    - meteorological data time increment, wave forcing increment
> 20                                                              ! RNDAY                               - TOTAL LENGTH OF SIMULATION (IN DAYS)
> 14.000 0.000 0.000 0.000 14.000 14.000 1.000 0.000 14.000       ! DRAMP                               - DURATION OF RAMP FUNCTION (IN DAYS)
> 0 1 0                                                           ! A00 B00 C00                         - TIME WEIGHTING FACTORS FOR THE GWCE EQUATION
39c39
< 0.019256 6.49585E-05 0.695 0.91121 188.966
---
> 0.019256 6.49585E-05 0.695 0.912559 293.192
41c41
< 0.100514 6.75977E-05 0.695 0.91121 214.485
---
> 0.100514 6.75977E-05 0.695 0.912559 168.642
43c43
< 0.046843 7.25229E-05 0.706 1 219.351
---
> 0.046843 7.25229E-05 0.706 1 203.58
45c45
< 0.141565 7.29212E-05 0.736 0.945412 312.666
---
> 0.141565 7.29212E-05 0.736 0.946239 328.405
47c47
< 0.046398 0.00013788 0.693 1.02116 137.643
---
> 0.046398 0.00013788 0.693 1.02093 257.599
49c49
< 0.242334 0.000140519 0.693 1.02116 163.162
---
> 0.242334 0.000140519 0.693 1.02093 133.049
53c53
< 0.030704 0.000145842 0.693 0.858609 85.9692
---
> 0.030704 0.000145842 0.693 0.860256 117.439
56c56
< 6.49585E-05 0.91121 188.966
---
> 6.49585E-05 0.912559 293.192
58c58
< 6.75977E-05 0.91121 214.485
---
> 6.75977E-05 0.912559 168.642
60c60
< 7.25229E-05 1 219.351
---
> 7.25229E-05 1 203.58
62c62
< 7.29212E-05 0.945412 312.666
---
> 7.29212E-05 0.946239 328.405
64c64
< 0.00013788 1.02116 137.643
---
> 0.00013788 1.02093 257.599
66c66
< 0.000140519 1.02116 163.162
---
> 0.000140519 1.02093 133.049
70c70
< 0.000145842 0.858609 85.9692
---
> 0.000145842 0.860256 117.439
72c72
< 2.6392E-06 1.07248 25.5189
---
> 2.6392E-06 1.07166 235.45
74c74
< 5.32341E-06 0.812264 274.193
---
> 5.32341E-06 0.814856 335.764
76c76
< 0.000281038 1.04277 326.324
---
> 0.000281038 1.0423 266.098
78c78
< 0.000278399 1.04277 300.805
---
> 0.000278399 1.0423 30.6482
80c80
< 0.000285963 1.02116 343.162
---
> 0.000285963 1.02093 313.049
82c82
< 0.00013524 1.02116 112.124
---
> 0.00013524 1.02093 22.1491
4931c4931
< -5 0 36 51                                                      ! NOUTE TOUTSE TOUTFE NSPOOLE         - ELEV STATION OUTPUT INFO (UNIT 61)
---
> -5 0 20 51                                                      ! NOUTE TOUTSE TOUTFE NSPOOLE         - ELEV STATION OUTPUT INFO (UNIT 61)
5187c5187
< -5 0 36 51                                                      ! NOUTV TOUTSV TOUTFV NSPOOLV         - VELOCITY STATION OUTPUT INFO (UNIT 62)
---
> -5 0 20 51                                                      ! NOUTV TOUTSV TOUTFV NSPOOLV         - VELOCITY STATION OUTPUT INFO (UNIT 62)
5191,5192c5191,5192
< -5 0.000000 36.000000 514                                       ! NOUTGE TOUTSGE TOUTFGE NSPOOLGE     - GLOBAL ELEVATION OUTPUT INFO (UNIT 63)
< -5 0.000000 36.000000 514                                       ! NOUTGV TOUTSGV TOUTFGV NSPOOLGV     - GLOBAL VELOCITY OUTPUT INFO (UNIT 64)
---
> -5 0.000000 20.000000 514                                       ! NOUTGE TOUTSGE TOUTFGE NSPOOLGE     - GLOBAL ELEVATION OUTPUT INFO (UNIT 63)
> -5 0.000000 20.000000 514                                       ! NOUTGV TOUTSGV TOUTFGV NSPOOLGV     - GLOBAL VELOCITY OUTPUT INFO (UNIT 64)
5208c5208,5209
< 2018-08-12 06:00                                                ! NCDATE                              - forcing start date
---
> 2018-08-28 06:00                                                ! NCDATE                              - forcing start date
> &SWANOutputControl SWAN_OutputHS=False, SWAN_OutputDIR=False, SWAN_OutputTM01=False, SWAN_OutputTPS=False, SWAN_OutputWIND=False, SWAN_OutputTM02=False, SWAN_OutputTMM10=False \

ghost · 2021-05-12T18:46:28Z

it looks like the 500 series NWS parameter was the problem, when calling adcprep --prepall

running again without WW3DATA

ghost · 2021-08-10T18:04:16Z

I'm currently running the following run:

(coupledmodeldriver)  Zachary.Burnett@hfe09  /scratch2/COASTAL/coastal/save/shared/working/zach/nems_adcirc/run_20210809_florence_multivariate_besttrack_120m_5members
 > check_completion
{
    "spinup": "running",
    "runs": {
        "vortex_4_variable_perturbation_4": "not_started",
        "vortex_4_variable_perturbation_5": "not_started",
        "vortex_4_variable_perturbation_1": "not_started",
        "vortex_4_variable_perturbation_3": "not_started",
        "original": "not_started",
        "vortex_4_variable_perturbation_2": "not_started"
    }
}

ghost mentioned this issue Apr 21, 2021

120 m and 250 m meshes running WITH ADCIRCPY #56

Closed

ghost mentioned this issue Apr 29, 2021

build several perturbed runs by passing multiple fort.22 filenames #84

Closed

ghost self-assigned this Apr 29, 2021

ghost closed this as completed May 5, 2022

This issue was closed.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

120 m and 250m meshes running with NEMSpy #86

120 m and 250m meshes running with NEMSpy #86

saeed-moghimi-noaa commented Apr 21, 2021

ghost commented Apr 26, 2021

ghost commented May 12, 2021 •

edited by ghost

Loading

ghost commented May 12, 2021 •

edited by ghost

Loading

ghost commented May 12, 2021

ghost commented May 12, 2021

ghost commented Aug 10, 2021

120 m and 250m meshes running with NEMSpy #86

120 m and 250m meshes running with NEMSpy #86

Comments

saeed-moghimi-noaa commented Apr 21, 2021

ghost commented Apr 26, 2021

ghost commented May 12, 2021 • edited by ghost Loading

NEMS + ADCIRC + BestTrack + WW3DATA

hotstart ADCIRC_SETUP.log

differences between spinup and hotstart fort.15

ghost commented May 12, 2021 • edited by ghost Loading

ghost commented May 12, 2021

difference between ADCIRC-only hotstart and NEMS+ADCIRC hotstart fort.15

ghost commented May 12, 2021

ghost commented Aug 10, 2021

ghost commented May 12, 2021 •

edited by ghost

Loading

hotstart `ADCIRC_SETUP.log`

differences between spinup and hotstart `fort.15`

ghost commented May 12, 2021 •

edited by ghost

Loading

difference between ADCIRC-only hotstart and NEMS+ADCIRC hotstart `fort.15`