Skip to content
@SentioGate

SentioGate

One OpenAI-compatible API for every model — on your own keys, at 0% markup

⚡ SentioGate

The Zero-Markup, OpenAI-Compatible LLM Router

Website Documentation Live Benchmarks Developer Hub License: Apache-2.0

One OpenAI-compatible endpoint for the models you already pay for.
Routing by cost, quality or latency with Bring-Your-Own-Key (BYOK) and 0% token markup. SentioGate automatically falls back to another model if one fails.

Client App / SDK ───▶ [ SentioGate Router ] ──┬──▶ OpenAI
                              │               ├──▶ Anthropic
                   ⚡ Cost / quality / latency ├──▶ Google Gemini
                   🛡️ Automatic fallback       ├──▶ DeepSeek
                   🔒 Encrypted key Vault      └──▶ Groq / Mistral / xAI / ...

🚀 Why Developers Choose SentioGate

  1. 0% Token Markup: SentioGate is Bring-Your-Own-Key (BYOK). You pay your providers' standard rates directly; SentioGate adds no fee per token.
  2. Routing you control: send model: "auto" and choose route_preference cost (default), quality or latency, or pin a specific provider/model.
  3. Drop-in OpenAI Compatibility: works with the OpenAI SDK, LangChain and other OpenAI-compatible tools by changing the base URL and API key.
  4. Automatic fallback: SentioGate automatically falls back to another model if one fails, so a single provider outage or rate limit doesn't have to break your app.
  5. Your keys stay yours: provider keys are stored encrypted in your Vault, decrypted only in memory to call the provider, and shown back masked.

📦 Client SDKs & Tools

Explore our open-source developer libraries and resources:

  • sentiogate-js — Lightweight, zero-dependency TypeScript & Node.js client SDK (@sentiogate/sdk). Supports streaming and opt-in retries.
  • sentiogate-python — Pure standard-library Python SDK (sentiogate-python) with streaming support.
  • llm-routing-benchmarks — Small offline synthetic benchmark demonstration; live metrics are on the benchmarks dashboard.
  • Developer Hub & Playground — Interactive visualizer showing routing in action.

⚡ Quickstart

Python

import os
from sentiogate import AutoRouterClient

client = AutoRouterClient(api_key=os.environ["SENTIOGATE_API_KEY"])

response = client.chat(
    model="auto",  # SentioGate picks the model
    messages=[{"role": "user", "content": "Explain quantum computing in 10 words."}],
    extra_body={"route_preference": "latency"},  # "cost" (default), "quality" or "latency"
)
print(response["choices"][0]["message"]["content"])

TypeScript / JavaScript

import { AutoRouter } from "@sentiogate/sdk";

const router = new AutoRouter({
  baseUrl: "https://api.sentiogate.dev",
  apiKey: process.env.SENTIOGATE_API_KEY,
});

for await (const chunk of router.streamChat({
  model: "auto",
  messages: [{ role: "user", content: "Optimize this SQL query..." }],
  extraBody: { route_preference: "cost" },
})) {
  process.stdout.write(chunk.choices?.[0]?.delta?.content || "");
}

Drop-in OpenAI SDK Replacement

import os
from openai import OpenAI

# Just update base_url and api_key
client = OpenAI(
    base_url="https://api.sentiogate.dev/v1",
    api_key=os.environ["SENTIOGATE_API_KEY"],
)

📊 Transparent Benchmarks & Data

We believe in open metrics. View provider latency and comparative benchmarks:


🌐 Official Links & Community

Pinned Loading

  1. llm-routing-benchmarks llm-routing-benchmarks Public

    Open TTFT, Throughput, and Hot-Failover Benchmarks for LLM Routing

    Python

  2. sentiogate-js sentiogate-js Public

    Official TypeScript & JavaScript Client SDK for SentioGate AI Router

    JavaScript

  3. sentiogate-python sentiogate-python Public

    Official Zero-Dependency Python Client SDK for SentioGate AI Router

    Python

  4. sentiogate.github.io sentiogate.github.io Public

    SentioGate Developer Hub, Live Router Simulator & Documentation

    HTML

Repositories

Showing 5 of 5 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…