Alibaba

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

An easy-to-use framework for large scale recommendation algorithms.

An end-to-end agent project for GPU kernel implementation, analysis, profiling, and iterative optimization. It helps an agent turn PyTorch logic or an existing kernel into a high-performance GPU kernel through a structured, profile-driven workflow.

Secure, fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.

Local-first telemetry collector for AI coding agents — unified OpenTelemetry events for Claude Code, Codex, Cursor and more. Token usage, cost, traces and security audit, exported anywhere.

An evaluation and evolution tool for Agent Skills.

The one data index for your agentic applications

A lightweight, lightning-fast, in-process vector database

A unified architecture deep learning framework designed specifically for ultra-large-scale sparse models.