Skip to content

mizcausevic-dev/otel-genai-fleet-summary

Repository files navigation

otel-genai-fleet-summary

CI License: AGPL-3.0-or-later

Fleet-summary for OTel GenAI OTLP span exports. Walks a directory of OTLP JSON files, applies governance rules per the OTel GenAI semantic conventions, and surfaces high-leverage findings.

Closes the fleet-summary quintet:

Part of the Kinetic Gain Suite.


What it flags

Code Severity Rule
missing-model-attribute 🔴 Span has no gen_ai.request.model — can't attribute usage / cost.
unauthorized-model 🔴 Span uses a model not in the --allowed-models whitelist. Shadow-IT signal.
high-error-rate 🔴 File's errored spans > threshold (default 5%).
missing-provider-attribute 🟠 Span has no gen_ai.provider.name.
token-volume-outlier 🟠 Span input or output tokens exceed configurable threshold (default 100K input / 50K output).
missing-cost-annotation 🟡 Span has no gen_ai.usage.cost — breaks FinOps rollups.
missing-operation-name 🟡 Span has no gen_ai.operation.name.

CLI

otel-genai-fleet-summary <traces-dir>
    [--format json|markdown|summary]
    [--allowed-models claude-sonnet-4,gpt-4o,...]
    [--error-rate-threshold 0.05]
    [--now <iso>] [--fail-on-high] [--out FILE]

Exit codes:

  • 0 — no high findings (or --fail-on-high not set)
  • 1 — high finding AND --fail-on-high set
  • 2 — usage / I/O error

Library API

import { summarize, toMarkdown } from "otel-genai-fleet-summary";

const report = summarize(files, {
  allowedModels: ["claude-sonnet-4", "gpt-4o"],
  errorRateThreshold: 0.05
});
console.log(report.byModel);        // per-model span counts
console.log(report.totals);         // spans + token totals + errors
console.log(report.findings);
console.log(toMarkdown(report));

Composes with

License

AGPL-3.0-or-later

About

Fleet-summary for OTel GenAI OTLP span exports. Flags missing model/provider attrs, unauthorized model usage (whitelist), high error rates, token outliers, missing cost annotations. Closes the fleet-summary quintet alongside agent-card / mcp-tool-card / prompt-provenance / evidence-bundle.

Topics

Resources

License

Code of conduct

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Packages

 
 
 

Contributors