Skip to content

Support automotive/inference checker versions via concise version.# variations in inference submission checker script#912

Open
arjunsuresh with Copilot wants to merge 5 commits into
devfrom
copilot/support-mlperf-automotive-versions
Open

Support automotive/inference checker versions via concise version.# variations in inference submission checker script#912
arjunsuresh with Copilot wants to merge 5 commits into
devfrom
copilot/support-mlperf-automotive-versions

Conversation

Copilot AI commented Apr 20, 2026

Copy link
Copy Markdown
Contributor

🧾 PR Checklist

  • Target branch is dev

📌 Note: PRs must be raised against dev. Do not commit directly to main.

📁 File Hygiene & Output Handling

  • No unintended files (e.g., logs, cache, temp files, pycache, output folders) are committed

📝 Comments & Communication

  • Proper inline comments are added to explain important or non-obvious changes

  • PR title and description clearly state what the PR does and why

  • Related issues (if any) are properly referenced (Fixes #, Related to #, etc.)

  • Problem summary

    • run-mlperf-inference-submission-checker is shared by inference and automotive.
    • Version selection needed to move away from top-level versions and into version variations to support both tracks cleanly.
  • What changed

    • Meta refactor (single file):
      • script/run-mlperf-inference-submission-checker/meta.yaml
      • Removed top-level version mapping usage (default_version + populated versions block), keeping versions: {}.
      • Converted version handling to variation-based mapping.
      • Applied reviewer feedback to make metadata concise using version.#.
      • Kept explicit overrides where behavior differs:
        • version.master (default) → master
        • version.r6.0master
  • Representative snippet

    variations:
      version.master:
        default: true
        group: version
        adr:
          submission-checker-src:
            version: master
    
      version.#:
        group: version
        adr:
          submission-checker-src:
            version: '#'
    
      version.r6.0:
        group: version
        adr:
          submission-checker-src:
            version: master
    
    versions: {}

🛡️ Safety & Security

  • No secrets or credentials are committed
  • Paths, shell commands, and environment handling are safe and portable

Copilot AI linked an issue Apr 20, 2026 that may be closed by this pull request
Copilot AI changed the title [WIP] Support mlperf-automotive versions Support automotive checker versions via version.* variations in inference submission checker script Apr 20, 2026
Copilot AI requested a review from arjunsuresh April 20, 2026 21:38
@arjunsuresh arjunsuresh changed the base branch from main to dev May 8, 2026 19:08
adr:
submission-checker-src:
version: master
r3.0:
version.r3.0:

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot can't we use version.# here to make the meta concise?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done in cc3bde4. I switched to a concise version.# variation and kept explicit overrides only where behavior differs (version.master default and version.r6.0 mapping to master).

Copilot AI changed the title Support automotive checker versions via version.* variations in inference submission checker script Support automotive/inference checker versions via concise version.# variations in inference submission checker script May 22, 2026
Copilot AI requested a review from arjunsuresh May 22, 2026 12:03
@arjunsuresh arjunsuresh marked this pull request as ready for review May 22, 2026 12:07
@arjunsuresh arjunsuresh requested a review from a team as a code owner May 22, 2026 12:07
@github-actions

github-actions Bot commented May 22, 2026

Copy link
Copy Markdown
Contributor

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support mlperf-automotive versions

2 participants