Skip to content
@deepinfra

Deep Infra

Inference cloud

Popular repositories Loading

  1. deepctl deepctl Public

    Command line tool for Deep Infra cloud ML inference service

    Rust 38 3

  2. deepinfra-node deepinfra-node Public

    Official TypeScript wrapper for DeepInfra Inference API

    TypeScript 21 3

  3. text-generation-inference text-generation-inference Public

    Forked from huggingface/text-generation-inference

    Large Language Model Text Generation Inference

    Python 9 2

  4. ocr-tools ocr-tools Public

    Python 5 2

  5. langchain langchain Public

    Forked from langchain-ai/langchain

    ⚡ Building applications with LLMs through composability ⚡

    Python 1

  6. deepinfra-python deepinfra-python Public

    Unofficial Python wrapper for the DeepInfra Inference API

    Python 1 1

Repositories

Showing 10 of 51 repositories
  • fastokens Public Forked from crusoecloud/fastokens

    Fast Tokens

    deepinfra/fastokens's past year of commit activity
    Rust 0 Apache-2.0 25 0 0 Updated Sep 25, 2026
  • docs Public

    DeepInfra platform documentation

    deepinfra/docs's past year of commit activity
    MDX 1 MIT 0 0 3 Updated Sep 24, 2026
  • deepinfra-hermes-sandbox Public

    DeepInfra cloud sandbox (deep_sands) terminal backend plugin for hermes-agent

    deepinfra/deepinfra-hermes-sandbox's past year of commit activity
    Python 0 MIT 1 0 0 Updated Sep 24, 2026
  • dynamo Public Forked from ai-dynamo/dynamo

    A Datacenter Scale Distributed Inference Serving Framework

    deepinfra/dynamo's past year of commit activity
    Rust 1 1,635 0 12 Updated Sep 24, 2026
  • courtade-kumar Public
    deepinfra/courtade-kumar's past year of commit activity
    TeX 0 0 0 1 Updated Sep 24, 2026
  • ming-image Public Forked from inclusionAI/Ming-Image
    deepinfra/ming-image's past year of commit activity
    Python 0 MIT 6 0 0 Updated Sep 22, 2026
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    deepinfra/vllm's past year of commit activity
    Python 0 Apache-2.0 22,916 0 0 Updated Sep 14, 2026
  • pi Public Forked from earendil-works/pi

    AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

    deepinfra/pi's past year of commit activity
    TypeScript 0 MIT 13,995 0 0 Updated Sep 10, 2026
  • TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM

    TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

    deepinfra/TensorRT-LLM's past year of commit activity
    Python 0 2,808 0 5 Updated Sep 2, 2026
  • deepinfra-node Public

    Official TypeScript wrapper for DeepInfra Inference API

    deepinfra/deepinfra-node's past year of commit activity
    TypeScript 21 MIT 3 7 2 Updated Sep 1, 2026
View all repositories

Sponsoring

  • @openclaw
GitHub Sponsor