Skip to content

fix: send Vertex service tier as headers#2445

Open
MukundaKatta wants to merge 1 commit into
googleapis:mainfrom
MukundaKatta:codex/vertex-service-tier-headers
Open

fix: send Vertex service tier as headers#2445
MukundaKatta wants to merge 1 commit into
googleapis:mainfrom
MukundaKatta:codex/vertex-service-tier-headers

Conversation

@MukundaKatta

Copy link
Copy Markdown
Contributor

Summary

  • map Vertex service_tier config to the Vertex service-tier HTTP headers
  • remove serviceTier from the Vertex generateContent request body once converted
  • preserve existing custom http_options headers when applying the service-tier headers

Fixes #2433

Testing

  • GOOGLE_GENAI_REPLAYS_DIRECTORY=/tmp/python-genai-replays uv run --with pytest --with pytest-asyncio pytest google/genai/tests/models/test_generate_content.py -q -k vertex_service_tier_uses_headers_not_body
  • python3 -m compileall -q google/genai/models.py google/genai/tests/models/test_generate_content.py
  • git diff --check

@Venkaiahbabuneelam Venkaiahbabuneelam self-assigned this May 26, 2026
@Venkaiahbabuneelam Venkaiahbabuneelam added the size:L Code changes between 40-100 lines label May 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:L Code changes between 40-100 lines

Projects

None yet

Development

Successfully merging this pull request may close these issues.

service_tier when using Vertex AI

2 participants