Skip to content

fix(config): read env under DFE_TRANSFORM_VECTOR_ only - #141

Merged
catinspace-au merged 1 commit into
mainfrom
fix/dfe-transform-vector-env-prefix
Nov 3, 2026
Merged

catinspace-au merged 1 commit into
mainfrom
fix/dfe-transform-vector-env-prefix

Conversation

@kazmosahebi

Copy link
Copy Markdown
Contributor

dfe-transform-vector read its settings under DFE_TRANSFORM_, the prefix dfe-transform-vrl also used. It now reads only DFE_TRANSFORM_VECTOR_, like the other DFE apps, for the config cascade, the flat readers, version check and the deployment contract's env_prefix. The old names are no longer read.

Rollout

These set the old names and need to move with this:

  • dfe-engine appmgmt/apps.yaml, the dfe-transform-vector block (lines 686-708).
  • dfe-infra apps.yaml and helm/charts/dfe-extras/files/apps.yaml, the same block.
  • dfe-infra argocd/values/apps/dfe-transform-vector/ profile-single.yaml, profile-scale.yaml and values.yaml.
  • dfe-docker docker-compose.yml, on chore/cleanup.

Do not rename by replacing the prefix. Every old VECTOR_* flat key doubles, so vector.data_dir is now DFE_TRANSFORM_VECTOR_VECTOR_DATA_DIR. DFE_TRANSFORM_VECTOR_DATA_DIR in values.yaml:26 is the old name, and left as it is, it reads as nothing and the data directory falls back to its default.

An older binary ignores the new names and still starts. A new binary given only the old names falls back to localhost:9092.

Testing

hyperi-ci check --quick, fmt and clippy pass. 83 integration tests on config and deployment pass. A binary run reads the new names and ignores the old ones, and only_the_dfe_transform_vector_prefix_reaches_the_config covers it. Not run: signals.rs, scaling.rs and the e2e tests, which need a live Vector. Their only change is the env var name.

dfe-transform-vector shared the DFE_TRANSFORM prefix with dfe-transform-vrl. It now reads every environment variable under DFE_TRANSFORM_VECTOR_, like the other DFE apps: the scalo cascade, the flat readers, the version-check opt-out and the deployment contract's env_prefix and secret names.

The old DFE_TRANSFORM_ names are not read. A flat key that begins VECTOR_ doubles up under the new prefix: DFE_TRANSFORM_VECTOR_BINARY is now DFE_TRANSFORM_VECTOR_VECTOR_BINARY.
@catinspace-au
catinspace-au merged commit 06e2cbd into main Nov 3, 2026
17 checks passed
@catinspace-au
catinspace-au deleted the fix/dfe-transform-vector-env-prefix branch November 3, 2026 00:01
@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants