On-demand ERA5 forcing workflow using JASMIN OS

[oj-tooth]

On-Demand ERA5v1 (bias corrected) atmospheric forcing workflow using JASMIN Cloud Object Storage

Aim: To develop an optional pre-processing step in the NPD run workflow to download ERA5v1 atmospheric forcing required to complete simulations on-demand from JASMIN Cloud Object Storage. This would enable users on new HPCs to define a 'rolling' forcing directory, which is populated with the necessary forcing netCDF files at runtime, with the option of being cleaned-up following a successful simulation to avoid consuming disk space across many machines to duplicate forcing datasets.

• Create new test npd-forcing bucket in JASMIN object store.
• Upload 2025-2026 ERA5v1 (bias corrected) netCDF forcing files to the bucket.
• Use s5cmd to create a pre-processing download + checksum step (SLURM dependency) job to be execute ahead of a simulation year/month etc.
• Refactor existing NPD run script to support (optional) on-demand forcing approach.