…the tar file where the prepbufr files live changed"

…y Michelle Harrold, solution by Michael Kavulich.

…ntStat tasks' METplus log files.

…ing cycles for CCPA and MRMS but not yet for NDAS or NOHRSC.

…thout performing unnecessary repeated pulls.

… comments).

… they're per-cycle or per-day.

…nup and comments.

…files from HPSS (and works with multiple cycles).

…e cleanup is happening.

…les, that are expected to be created once the task is finished actually get created. This is needed because it is possible that for some forecast hours for which there is overlap between cycles, the files are being retrieved and processed by the get_obs_... task for another cycle.

…nd EnsembleStat tasks such that GenEnsProd does not depend on the completion of get_obs_... tasks (because it doesn't need observations) but only forecast output while EnsembleStat does.

…d due to changes to dependencies of GenEnsProd tasks in previous commit(s).

…tending to time out for 48-hour forecasts.

…sure PcpCombine operates only on those hours unique to the cycle, i.e. for those times starting from the initial time of the cycle to just before the initial time of the next cycle. For the PcpCombine_obs task for the last cycle, allow it to operate on all hours of that cycle's forecast. This ensures that the PcpCombine tasks for the various cycles do not clobber each other's output. Accordingly, change the dependencies of downstream tasks that depend on PcpCombine obs output to make sure they include all PcpCombine_obs tasks that cover the forecast period of the that downstream task's cycle.

…ossibly also get_obs_ndas by putting in sleep commands.

…bs files.

…es user-specifiable.

…get_obs_...sh scripts.

…gional_get_verif_obs.sh since those are now in the ush/get_obs_[ccpa|mrms|ndas|nohrsc].sh scripts.

…e_util_funcs.sh.

…ow goes into a cycle-based subdirectory (under the experiment directory), as opposed to a obs day based subdirectory.

…k flag files should be placed; fix template for output files from pcpcombine_obs tasks.

…nding task is day-based (i.e. it is run for each day for which obs are needed). The script now also creates a flag file indicating it completed successfully (needed for the workflow to work properly).

…er in config_defaults.yaml.

…r to have cycledefs for obs-day-based tasks that include only the obs days for which obs are actually needed but not on any days (inbetween the first and last obs days over all cycles) for which obs are not needed.

…oth for instantaneous and cumulative fields, and pass this info to the ROCOTO xml generation system.

…ssing, and deterministic vx.

…s of whether it succeeded or failed).

…tead of setting it as an enviroment variable in the rocoto xml. This makes it possible to change their settings by chaning the values in var_defns.yaml and rerunning the get_obs_... tasks.

…ccumlated vx fields are less than or equal to the forecast length. This check is also made in the workflow yaml files, but if all the accumulation periods happen to be greater than the forecast length, then the field must be completely removed from verification (i.e. its vx tasks must be removed from the workflow), and that can only be done via this check in setup.py; it can't be done in the workflow task yaml files.

… and verified in GridStat.

…cast output at new location.

…all accumulation.

…pes of obs are available on NOAA HPSS. Use these new variables in file name templates.

…ult.sh so that they're more readable.

…se are now obtained by adding 6-hourly in the obs (as opposed to before, where we just got the 6 or 24 hourly obs without the option to add the 6-hourly to get 12 and 18).

… on a given day at which a given types of obs should be retrieved.

… times on a given day at which a given types of obs should be retrieved. Remove the arrays that specify the combined forecast output times for all cycles.

… of commit hash cae50b5, and remove file (exregional_run_met_pcpcombine.sh) that should NOT have been.

…be run) are calculated (and corresponding files checked for), including renaming of the file set_vx_fhr_list.sh to set_leadhrs.sh.

…e used.

…on of new vx config parameters to allow the workflow to have obs-day-based as well as cycle-based tasks.

…hon scripts) in previous commits.

… running out of time.

… task for NOHRSC; fix task dependencies.

…SNOW obs, it's the netcdf files that come out of PcpCombine_obs tasks that are used for verification.

…App configuration file are used when running the Pb2nc task (as opposed to hard-coding file names).

…rectory having the name of the valid day (of the form "YYYYMMDD") should be assumed to exist under the specified source directory, and whether such a subdirectory should be created under the specified output directory. Previously, such a subdirectory was always assumed to exist/created; now, it is an option.

…make sure that the get_obs tasks place the files (and name them) according to the file name templates specified for each obs type in the SRW App configuration file. Also, remove the variable basedir_proc since it is redundant.

…obs file.