openinference

Multi-language agent runtime and library for execution scope management, lifecycle events, and middleware on tool and LLM calls.

OTel Plugin for Hermes Agent

Open your AI agents' black box. The waste is between your agents, not inside them. Four deterministic detectors over one trace file, priced from real usage fields. Hosted at boxdawn.com.

Find where AI apps break first — and block regressions before they ship.

Rust-first, local-first observability & debugging for LLM agents: capture, inspect, replay, diff, and export traces (OpenTelemetry-compatible).

Agent-native OTel router. One-line auto-instrument for Anthropic / OpenAI / OpenRouter / Vercel AI. Counterfactual replay, reversible PII masking, `scry` CLI for agents to debug themselves. Composes with Braintrust / Phoenix / Langfuse — don't replace.

Does your LLM telemetry tell the truth? Replays provider responses through LLM instrumentation libraries and checks every reported value against the wire.

Production-inspired AI observability lab: a traced and evaluated fictional banking RAG assistant with OpenTelemetry, Phoenix, prompt experiments, guardrails, and optional Dynatrace fan-out.

BUFI Minions — self-improving Gemini 3 agents with Arize Phoenix observability (OpenInference tracing, Phoenix MCP self-introspection, LLM-as-judge evals). Devpost 'Agents for Real-World Challenges' Arize track.

A truth-first visual observatory for understanding, replaying, comparing, and monitoring AI agent runs.

Signed, tamper-evident provenance records for AI agent runs

TracePilot: Gemini CLI fork with Phoenix/OpenInference tracing, MCP self-introspection, safety gates, redaction, evals, and a verified broken-repo repair loop

Zero-install viewer for LLM agent traces: OTLP or Jaeger JSON in, waterfall, span tree, tool calls, tokens and cost out.

Turn production LLM failures into regression tests, automatically.

Catch the step where an AI agent contradicts its own earlier decision. CLI and adapters for LangGraph, CrewAI, Letta, OpenInference, DBOS and multi-agent logs, plus an expiry read for long-running agents.

Test whether agent runs preserve the execution data you may need later.

Next.js demo: Scalekit AgentKit tool executions and OpenAI LLM calls in one Arize AX trace — public-API wrapper, not a prototype patch.

Passive OpenInference/OTLP tracing adapter for Deep Agents Code Hooks v2

🛡️ Catch unsafe AI agent actions before they execute — explainable risk scoring, injection detection, and real-time containment powered by SigNoz & OpenTelemetry.

Recompute what your LLM traces cost, offline, from OTLP, Langfuse or Phoenix exports, with cache and reasoning tokens priced.