[rrfs-nco] Processing Jobs Should Fail with Missing Data?

[JamesPolly-NCO]

In ops, we rely on job failures to indicate problems (i.e. obs data availability).

Despite having no data to process, the following obs processing jobs will complete ("successfully") without failure:

• jrrfs_det_process_smoke: dummy emissions file will be used.
• jrrfs_det_process_radar: warning appears in log
• jrrfs_enkf_process_radar: warning appears in log
• jrrfs_det_process_lightning: no warnings, just declaration of success.
• This list is not complete, and should be treated as an indication of a potentially broad problem that needs to be addressed.

If downstream RRFS jobs rely on these processing jobs to actually find and use obs, then these jobs should fail when there is no data to process.

If the missing data is not actually needed (i.e. this is "data of opportunity") then we should get some kind of notification to this effect, exact nature of this message TBD.

[WeiWei-NCO]

When obs data is missing, we need a clear message indicating which file is missing/empty, including its full path at the original location. This message should start with WARNING: or FATAL ERROR: depending on whether it is data-of-opportunity or not.

When a dummy emission file is used, we still expect a WARNING:, followed by additional info indicating a dummy file is being used for this cycle.

[JamesPolly-NCO]

@ShunLiu-NOAA Reminder that we need your input here on whether or not this job should fail.

[ShunLiu-NOAA]

@JamesPolly-NCO Thank you for your reminder. We will follow @WeiWei-NCO's suggestion to give WARNING information.