Skip to content

[dev/gfs.v17] Module files update 1: non-gdas components to use operational modules on wcoss2#5010

Merged
DavidHuber-NOAA merged 13 commits into
NOAA-EMC:dev/gfs.v17from
TravisElless-NOAA:feature/v17_update_modules
Jun 17, 2026
Merged

[dev/gfs.v17] Module files update 1: non-gdas components to use operational modules on wcoss2#5010
DavidHuber-NOAA merged 13 commits into
NOAA-EMC:dev/gfs.v17from
TravisElless-NOAA:feature/v17_update_modules

Conversation

@TravisElless-NOAA

Copy link
Copy Markdown
Contributor

Description

This PR brings updates to the v17 package to allow for the use of operational versions of module files on wcoss2. Changes are made to allow module file versions to be updated via build.ver/run.ver Module file versions included in these wcoss2 version files will be the modules used during production. Noting a future PR will be needed for the GDASApp based modules and virtual environment once those are added to the production environment.

Type of change

  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this change expected to change outputs (e.g. value changes to existing outputs, new files stored in COM, files removed from COM, filename changes, additions/subtractions to archives)? NO
  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? NO

How has this been tested?

Initial tests passed on wcoss2. Will run full suite

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • Any new scripts have been added to the .github/CODEOWNERS file with owners
  • I have made corresponding changes to the system documentation if necessary

TravisElless-NOAA and others added 3 commits June 12, 2026 14:25
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

@DavidHuber-NOAA DavidHuber-NOAA left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. Thanks for the work on this @TravisElless-NOAA!

@DavidHuber-NOAA

Copy link
Copy Markdown
Member

I'll run a C6 case for this.

@DavidHuber-NOAA DavidHuber-NOAA added the CI-GaeaC6-Running (CM) CI testing is being run locally on Gaea C6. label Jun 12, 2026
@DavidHuber-NOAA

Copy link
Copy Markdown
Member

All tests passed on C6:

############################# C48_ATM_5010 #############################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Jun 12 2026 17:35:23    Jun 12 2026 18:30:09
###################### C48mx500_3DVarAOWCDA_5010 #######################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Jun 12 2026 17:35:27    Jun 12 2026 17:50:11
202103250000        Done    Jun 12 2026 17:35:27    Jun 13 2026 04:20:12
####################### C48mx500_hybAOWCDA_5010 ########################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Jun 12 2026 17:35:31    Jun 12 2026 17:50:15
202103250000        Done    Jun 12 2026 17:35:31    Jun 12 2026 20:25:26
############################ C48_S2SW_5010 #############################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Jun 12 2026 17:35:35    Jun 12 2026 20:35:37
########################## C96_atm3DVar_5010 ###########################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Jun 12 2026 17:35:39    Jun 12 2026 17:55:52
202112210000        Done    Jun 12 2026 17:35:39    Jun 13 2026 04:40:29
202112210600        Done    Jun 12 2026 17:35:39    Jun 13 2026 05:00:26
######################### C96C48_hybatmDA_5010 #########################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Jun 12 2026 17:35:43    Jun 12 2026 17:55:57
202112210000        Done    Jun 12 2026 17:35:43    Jun 13 2026 04:00:56
202112210600        Done    Jun 12 2026 17:35:43    Jun 13 2026 05:00:29
####################### C96C48_hybatmsnowDA_5010 #######################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Jun 12 2026 17:35:47    Jun 12 2026 17:56:03
202112201800        Done    Jun 12 2026 17:35:47    Jun 13 2026 04:10:31
202112210000        Done    Jun 12 2026 17:35:47    Jun 13 2026 05:00:35
####################### C96C48_hybatmsoilDA_5010 #######################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202205150600        Done    Jun 12 2026 17:35:51    Jun 12 2026 17:56:10
202205151200        Done    Jun 12 2026 17:35:51    Jun 13 2026 04:01:04
202205151800        Done    Jun 12 2026 17:35:51    Jun 13 2026 05:05:37
#################### C96C48mx500_S2SW_cyc_gfs_5010 #####################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Jun 12 2026 17:35:56    Jun 12 2026 17:56:18
202112201800        Done    Jun 12 2026 17:35:56    Jun 13 2026 05:20:45
202112210000        Done    Jun 12 2026 17:35:56    Jun 13 2026 06:05:41

@DavidHuber-NOAA DavidHuber-NOAA added CI-Gaeac6-Passed (cm) Manual CI passed on Gaea C6 and removed CI-GaeaC6-Running (CM) CI testing is being run locally on Gaea C6. labels Jun 15, 2026
@TravisElless-NOAA

Copy link
Copy Markdown
Contributor Author

Tests on WCOSS2 will eventually pass as shown below with one caveat currently. Several arch jobs did initially fail as the node ddxfer01 does not recognize the cray-pals/1.3.2 module loaded by load modules. This leads to a couple of questions:

  1. are the transfer nodes expected to see all the modules and I should open up a GDIT ticket to get this resolved or are transfer nodes used just to transfer data not expected to have the full suite of modules as they are used to just transfer data and the GDIT response would be "don't load that module"

  2. if the answer to 1 is the later, the solution maybe to 1) update the arch jobs to use a setup module as the python environment is really the only module needed on wcoss. This would require adding hpss module info to the rest of the setup module files for this to work on other machines, or 2) we create a new module class within load modules for archiving purposes.

Thought I would bring this up here in case anyone has a preference on the way forward. But the frequency which this hit ddxfer01 means we should have a solution in place before merging

gw_cistat -r /lfs/h2/emc/ptmp/travis.j.elless/tests/v17_module/
###################### C48_ATM_test_module_update ######################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Jun 12 2026 15:35:46    Jun 12 2026 17:15:25
############### C48mx500_3DVarAOWCDA_test_module_update ################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Jun 12 2026 15:35:23    Jun 12 2026 16:05:24
202103250000        Done    Jun 12 2026 15:35:23    Jun 12 2026 19:35:45
################ C48mx500_hybAOWCDA_test_module_update #################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Jun 12 2026 15:35:10    Jun 12 2026 16:05:11
202103250000        Done    Jun 12 2026 15:35:10    Jun 12 2026 17:30:52
################# C48_S2SW_extended_test_module_update #################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Jun 12 2026 15:35:35    Jun 15 2026 17:45:35
202103231800        Done    Jun 12 2026 15:35:35    Jun 12 2026 18:55:50
############### C96_atm3DVar_extended_test_module_update ###############
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Jun 12 2026 15:35:16    Jun 12 2026 16:05:36
202112210000        Done    Jun 12 2026 15:35:16    Jun 15 2026 18:00:54
202112210600        Done    Jun 12 2026 15:35:16    Jun 12 2026 21:35:36
202112211200        Done    Jun 12 2026 16:10:40    Jun 15 2026 17:51:15
202112211800        Done    Jun 12 2026 21:40:55    Jun 13 2026 02:30:33
################## C96C48_hybatmDA_test_module_update ##################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Jun 12 2026 15:35:46    Jun 12 2026 16:05:21
202112210000        Done    Jun 12 2026 15:35:46    Jun 12 2026 19:45:30
202112210600        Done    Jun 12 2026 15:35:46    Jun 12 2026 18:50:49
################ C96C48_hybatmsnowDA_test_module_update ################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Jun 12 2026 15:35:44    Jun 12 2026 16:15:32
202112201800        Done    Jun 12 2026 15:35:44    Jun 12 2026 19:10:55
202112210000        Done    Jun 12 2026 15:35:44    Jun 12 2026 19:06:01
################ C96C48_hybatmsoilDA_test_module_update ################
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202205150600        Done    Jun 12 2026 15:35:16    Jun 12 2026 16:05:38
202205151200        Done    Jun 12 2026 15:35:16    Jun 12 2026 19:01:05
202205151800        Done    Jun 12 2026 15:35:16    Jun 12 2026 18:50:51
############# C96C48mx500_S2SW_cyc_gfs_test_module_update ##############
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Jun 12 2026 15:35:45    Jun 12 2026 16:15:19
202112201800        Done    Jun 12 2026 15:35:45    Jun 12 2026 19:11:03
202112210000        Done    Jun 12 2026 15:35:45    Jun 15 2026 19:55:42
202112211800        Done    Jun 12 2026 16:20:56    Jun 15 2026 20:05:40

@TravisElless-NOAA

Copy link
Copy Markdown
Contributor Author

Noting here that I opened a GDIT ticket and they took ddxfer01 offline for repairs. So likely don't need to make further updates in regards to that issue

@DavidHuber-NOAA DavidHuber-NOAA added the CI-Wcoss2-Passed CI testing on WCOSS for this PR has completed successfully label Jun 17, 2026
@DavidHuber-NOAA

Copy link
Copy Markdown
Member

@TravisElless-NOAA can you resolve the conflict in run.wcoss2.ver?

@TravisElless-NOAA

Copy link
Copy Markdown
Contributor Author

Should be good to go now @DavidHuber-NOAA

@DavidHuber-NOAA DavidHuber-NOAA merged commit ab5f38d into NOAA-EMC:dev/gfs.v17 Jun 17, 2026
7 checks passed
@TravisElless-NOAA TravisElless-NOAA deleted the feature/v17_update_modules branch June 22, 2026 14:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI-Gaeac6-Passed (cm) Manual CI passed on Gaea C6 CI-Wcoss2-Passed CI testing on WCOSS for this PR has completed successfully

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants