Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[develop] fixes to enable stochastic physics #870

Merged
merged 5 commits into from
Jul 28, 2023

Conversation

willmayfield
Copy link
Collaborator

DESCRIPTION OF CHANGES:

These changes allow ensemble mode to use seeds generated to be unique to the forecast cycle and ensemble member, and they also allow stochastic physics to be turned on in deterministic mode.

Type of change

  • Bug fix (non-breaking change which fixes an issue)

TESTS CONDUCTED:

A configuration was created which turned on all stochastic physics schemes (SPP, SPPT, SKEB, SHUB) except land surface perturbations. This test was successful and shown to use differing stochastic physics seeds for each ensemble member in the output forecasts. Other tests were run by @JeffBeck-NOAA showing that a deterministic forecast may now be run with stochastic physics.

Note: Land surface perturbations were left off because the current default settings for it in config_defaults.yaml no longer seem to work.

  • hera.intel
  • orion.intel
  • cheyenne.intel
  • cheyenne.gnu
  • gaea.intel
  • jet.intel
  • wcoss2.intel
  • NOAA Cloud (indicate which platform)
  • Jenkins
  • fundamental test suite
  • comprehensive tests (specify which if a subset was used)

DOCUMENTATION:

It was previously discussed with @MichaelLueken and @gspetro-NOAA that stochastic physics should be noted to no longer work in the documentation. Hopefully this PR does away with that need.

ISSUE:

This PR fixes issue #818.

CONTRIBUTORS (optional):

@JeffBeck-NOAA

Copy link
Collaborator

@MichaelLueken MichaelLueken left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@willmayfield -

Thank you very much for addressing the stochastic physics issues! I was able to run both a deterministic and ensemble test with stochastic physics activated and both behaved as they should.

As part of this PR, would you mind changing FV3_NML_FP on line 103 to fv3_nml_ensmem_fp? Seeing that the specified seeds were being updated in the parent level input.nml was confusing and isn't correct.

I will go ahead and approve this PR now and kick off the automated Jenkins tests (the above modification won't affect the automated testing).

@MichaelLueken MichaelLueken added the run_we2e_coverage_tests Run the coverage set of SRW end-to-end tests label Jul 28, 2023
@willmayfield
Copy link
Collaborator Author

@MichaelLueken and @gsketefian thank you for your reviews! I fixed the comment that Michael requested. And I want to thank @JeffBeck-NOAA for his help with this PR!

@MichaelLueken
Copy link
Collaborator

The Cheyenne Intel WE2E tests were manually ran on Hera and all tests successfully passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
custom_GFDLgrid__GFDLgrid_USE_NUM_CELLS_IN_FILENAMES_eq_FALSE      COMPLETE              10.72
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_plot     COMPLETE              29.51
grid_RRFS_CONUS_25km_ics_NAM_lbcs_NAM_suite_GFS_v16                COMPLETE              19.57
grid_RRFS_CONUScompact_13km_ics_HRRR_lbcs_RAP_suite_HRRR           COMPLETE              25.72
grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta    COMPLETE               8.41
grid_SUBCONUS_Ind_3km_ics_HRRR_lbcs_HRRR_suite_HRRR                COMPLETE              16.30
pregen_grid_orog_sfc_climo                                         COMPLETE               7.42
specify_template_filenames                                         COMPLETE               7.28
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             124.93

The Cheyenne GNU WE2E tests were manually ran on Hera and all tests successfully passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
grid_CONUS_25km_GFDLgrid_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16      COMPLETE              20.19
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta      COMPLETE             229.59
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp  COMPLETE             108.08
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v17_p8_plot  COMPLETE              27.15
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR             COMPLETE              36.25
grid_RRFS_CONUScompact_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16   COMPLETE              22.17
grid_RRFS_NA_13km_ics_FV3GFS_lbcs_FV3GFS_suite_RAP                 COMPLETE             320.61
grid_SUBCONUS_Ind_3km_ics_NAM_lbcs_NAM_suite_GFS_v16               COMPLETE              51.16
specify_EXTRN_MDL_SYSBASEDIR_ICS_LBCS                              COMPLETE              10.11
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             825.31

Automated Jenkins tests passed for Hera GNU:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used
----------------------------------------------------------------------------------------------------
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_nemsio_2019061200         COMPLETE              18.73
get_from_NOMADS_ics_FV3GFS_lbcs_FV3GFS                             COMPLETE              43.68
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR             COMPLETE             232.63
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp  COMPLETE              17.50
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta      COMPLETE              35.61
quilting_false                                                     COMPLETE              13.82
grid_SUBCONUS_Ind_3km_ics_HRRR_lbcs_RAP_suite_WoFS_v0              COMPLETE              22.31
GST_release_public_v1                                              COMPLETE              53.84
MET_verification_only_vx                                           COMPLETE               0.14
MET_ensemble_verification_only_vx_time_lag                         COMPLETE               3.87
nco_grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16      COMPLETE             343.19
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             785.3

Automated Jenkins tests passed for Hera Intel:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used
----------------------------------------------------------------------------------------------------
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_grib2_2019061200          COMPLETE               6.04
get_from_HPSS_ics_GDAS_lbcs_GDAS_fmt_netcdf_2022040400_ensemble_2  COMPLETE             771.35
get_from_HPSS_ics_HRRR_lbcs_RAP                                    COMPLETE              13.96
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp  COMPLETE               8.14
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2        COMPLETE               6.02
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16          COMPLETE              11.32
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_RAP_suite_RAP                 COMPLETE               9.69
grid_RRFS_CONUS_25km_ics_GSMGFS_lbcs_GSMGFS_suite_GFS_v15p2        COMPLETE               6.18
grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2         COMPLETE             249.58
grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16           COMPLETE             310.26
grid_RRFS_CONUScompact_3km_ics_HRRR_lbcs_RAP_suite_HRRR            COMPLETE             335.21
pregen_grid_orog_sfc_climo                                         COMPLETE               6.36
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE            1734.11

Automated Jenkins tests passed for Jet:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used
----------------------------------------------------------------------------------------------------
community                                                          COMPLETE              17.34
custom_ESGgrid                                                     COMPLETE              15.69
custom_GFDLgrid                                                    COMPLETE              10.77
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_nemsio_2021032018         COMPLETE               9.05
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h     COMPLETE              51.32
get_from_HPSS_ics_RAP_lbcs_RAP                                     COMPLETE              15.14
grid_RRFS_AK_3km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR                 COMPLETE             232.23
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_plot     COMPLETE              41.07
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2        COMPLETE               7.46
grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta       COMPLETE             529.52
nco_grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_RAP_suite_HRRR       COMPLETE              10.88
process_obs                                                        COMPLETE               0.38
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             940.85

Automated Jenkins tests passed for Orion:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used
----------------------------------------------------------------------------------------------------
deactivate_tasks                                                   COMPLETE               1.05
get_from_AWS_ics_GEFS_lbcs_GEFS_fmt_grib2_2022040400_ensemble_2me  COMPLETE             749.72
grid_CONUS_3km_GFDLgrid_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta   COMPLETE             255.84
grid_RRFS_AK_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_plot        COMPLETE             139.48
grid_RRFS_CONUS_25km_ics_NAM_lbcs_NAM_suite_RRFS_v1beta            COMPLETE              13.87
grid_RRFS_CONUS_25km_ics_GSMGFS_lbcs_GSMGFS_suite_GFS_2017_gfdlmp  COMPLETE               9.95
grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR              COMPLETE             385.33
grid_RRFS_CONUScompact_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16   COMPLETE              27.98
grid_RRFS_CONUScompact_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16    COMPLETE             281.64
grid_SUBCONUS_Ind_3km_ics_FV3GFS_lbcs_FV3GFS_suite_WoFS_v0         COMPLETE              13.05
nco                                                                COMPLETE               7.58
2020_CAD                                                           COMPLETE              30.46
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE            1915.95

Moving forward with merging this work now.

@MichaelLueken MichaelLueken merged commit 26b3ac8 into ufs-community:develop Jul 28, 2023
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run_we2e_coverage_tests Run the coverage set of SRW end-to-end tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Stochastic physics is not working correctly after yaml/Python changes to the workflow
4 participants