feat(eap-items): read array attributes from typed map columns for recent queries

[phacops]

Summary

Array attributes have been double-written into the typed attributes_array_{string,int,float,bool} map columns since 2026-06-22 (#8079, follow-up to #8056). This PR switches the array-attribute filter read path to those typed columns when the queried window is new enough that the columns are fully populated, and otherwise keeps reading the legacy attributes_array JSON column.

The gating mirrors the existing use_sampling_factor pattern: read the typed columns only when the query's earliest bound is on/after 2026-06-23 00:00 UTC (the day after double-writing began), so we never read typed columns for data that predates the double-write.

Linear: EAP-562

What it does

• USE_ARRAY_MAP_COLUMNS_TIMESTAMP_SECONDS (1782172800, 2026-06-23 UTC) + use_array_map_columns(meta) in web/rpc/common/common.py, mirroring use_sampling_factor. Overridable via the use_array_map_columns_timestamp_seconds state config; a value of 0 disables the typed-column read path entirely.
• type_array_to_membership_array_expression_from_typed_columns in protos/common.py — the typed-column counterpart of type_array_to_membership_array_expression. It builds a normalized Array(String) via arrayConcat over all four typed columns (string as-is, int/float via toString, bool as 'true'/'false'), so the per-element comparisons (_type_array_membership_rhs_expression) keep matching the JSON-column behaviour. Array elements are routed to exactly one typed column by type (AttributeMap::insert_array) — including array ints, which live only in attributes_array_int — so all four columns are read and no element is duplicated.
• Threaded use_array_map_columns through trace_item_filters_to_expression / _trace_item_filter_key_expression, and passed use_array_map_columns(meta) at every resolver/endpoint filter call site (trace-item table, time series, stats, heatmap, cross-item queries, get-traces, trace-item details).
• Threaded it through the conditional-aggregation chain too (aggregation_to_expression, get_count_column, get_average_sample_rate_column, get_confidence_interval_column, the extrapolation/_get_ci_* helpers → _get_condition_in_aggregation), so countIf/sumIf predicates filtering on array attributes also use the typed columns. (Addresses the Seer review.)
• get_field_existence_expression now treats the typed arrayConcat membership expression like arrayMap (notEmpty), so exists_filter on array keys works against the typed columns.

Scope / safety

This change covers the filter (WHERE / membership) read path, including conditional-aggregation filter predicates — the explicitly-named "read-path filter support" follow-up. The SELECT clause and the aggregate field itself continue to read the always-written attributes_array JSON column, so queries stay read-consistent for any window (both column families hold identical data for post-2026-06-22 rows). Migrating those representation-returning paths is left as a separate change.

Tests

tests/web/rpc/test_common.py:

• test_use_array_map_columns — cutoff/boundary behaviour and the 0-disables config, mirroring test_use_sampling_factor.
• TestTraceItemFiltersArrayMapColumns — LIKE / EQUALS / exists_filter on array keys route to arrayConcat over the four typed columns when enabled, and to arrayMap over attributes_array by default; the typed builder rejects non-array keys.

tests/web/rpc/test_aggregation.py:

• test_conditional_aggregation_array_filter_uses_typed_columns — a conditional aggregation whose filter is on an array attribute reads the four typed columns when enabled, and the JSON column otherwise.

Verified locally (Python 3.13 venv + built Rust extension): all unit/expression tests in test_common.py and test_aggregation.py pass, ruff format --check + ruff check clean. (Integration tests needing a live ClickHouse run in CI.)

🤖 Generated with Claude Code

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit 8e90787. Configure here.}