Skip to content

feat(self-managed): Tier-1 active-active defaults under highAvailability #987

Closed

Description

@shobham-nv

Description

Apply P0 Tier-1 active–active defaults when highAvailability.profile: production: replicaCount 2, soft pod anti-affinity on hostname, topology spread on topology.kubernetes.io/zone, PDB minAvailable 1, rollingUpdate maxSurge 1 / maxUnavailable 0.
In-scope services: NVCF API, grpc-proxy, http-invocation, admin-token-issuer-proxy; llm-api-gateway when the LLM addon is enabled.
Do not introduce application-level leader election for Tier-1.

Definition of Done

  • Production HA profile sets the above defaults for API, grpc-proxy, invocation, admin-token-issuer-proxy
  • llm-api-gateway follows the same pattern when enabled
  • Charts receive values via global.yaml.gotmpl (add chart hooks only if missing)
  • single-node profile remains single-replica friendly
  • Readiness probes continue to gate Service endpoints

By submitting this issue, you acknowledge that you are an assigned member of the NVCF development team and agree to follow our code of conduct and our contributing guidelines.

Activity

  1. self-assigned this
    on Aug 19, 2026
  2. added theissue type on Aug 19, 2026
  3. added
    invocation-planeauto-scaler, grpc-proxy, invocation-service, rate-limiter, event-ledger
    on Sep 22, 2026
  4. shobham-nv commented on Oct 9, 2026

    @shobham-nv
    ContributorAuthor

    Delivered in #2052 (merged). Implemented as highAvailability.mode: none | preferred | enforced instead of the profile values described here; none covers the single-node case. Tier-1 services run 2 replicas with anti-affinity, zone spread, minAvailable: 1 PDB and maxSurge: 1 / maxUnavailable: 0: api, adminIssuerProxy, llmApiGateway, ratelimiter, natsAuthCalloutService, nvctApi, notary, sis, apiKeys, reval, ess.

    Note: grpc-proxy and invocation-service stay at 1 replica (placement pre-wired, no HA PDB). Their worker callbacks must reach the pod that accepted the request, so scaling them is tracked under the Phase 2 Envoy work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

invocation-planeauto-scaler, grpc-proxy, invocation-service, rate-limiter, event-ledger

Type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions