Skip to content

Add llama3.1-70b E2E test scripts#4279

Draft
chiajunglien wants to merge 5 commits into
AI-Hypercomputer:mainfrom
CIeNET-International:emma/e2e-training-llama3-70b
Draft

Add llama3.1-70b E2E test scripts#4279
chiajunglien wants to merge 5 commits into
AI-Hypercomputer:mainfrom
CIeNET-International:emma/e2e-training-llama3-70b

Conversation

@chiajunglien

@chiajunglien chiajunglien commented Jun 26, 2026

Copy link
Copy Markdown

Description

This PR introduces end-to-end (E2E) testing and validation pipelines for the Llama3.1 70B model in MaxText.

Blocked by:
https://buganizer.corp.google.com/issues/528113447
https://buganizer.corp.google.com/issues/529650634

Tests

Pre-Training:

export RUN_ID=$(date +%Y-%m-%d-%H-%M)
bash tests/end_to_end/tpu/llama3.1/70b/test_llama3.1_70b_to_mt.sh $RUN_ID
bash tests/end_to_end/tpu/llama3.1/70b/test_llama3.1_70b.sh $RUN_ID

SFT:

export RUN_ID=$(date +%Y-%m-%d-%H-%M)
bash tests/end_to_end/tpu/llama3.1/70b/test_llama3.1_70b_to_mt.sh $RUN_ID
bash tests/end_to_end/tpu/llama3.1/70b/test_llama3.1_70b_sft.sh $RUN_ID

RL:

export RUN_ID=$(date +%Y-%m-%d-%H-%M)
bash tests/end_to_end/tpu/llama3.1/70b/test_llama3.1_70b_to_mt.sh $RUN_ID
bash tests/end_to_end/tpu/llama3.1/70b/test_llama3.1_70b_rl.sh $RUN_ID

Checklist

Before submitting this PR, please make sure (put X in square brackets):

  • I have performed a self-review of my code. For an optional AI review, add the gemini-review label.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have run end-to-end tests tests and provided workload links above if applicable.
  • I have made or will make corresponding changes to the doc if needed, including adding new documentation pages to the relevant Table of Contents (toctree directive) as explained in our documentation.

….1-70b

Introduces E2E test configurations and scripts for llama3.1-70b model,
covering both inference decoding and pre-training validation pipelines.
Comment thread tests/end_to_end/tpu/llama3.1/70b/test_llama3.1_70b_to_mt.sh Outdated
Comment thread tests/end_to_end/tpu/llama3.1/70b/test_llama3.1_70b_to_mt.sh
@chiajunglien chiajunglien changed the title Add llama3.1-70b E2E test scripts for pre-training Add llama3.1-70b E2E test scripts Jun 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants