DeepSeek-R1 7B INT4 at 69.3 tok/s on a $300 RTX 3060. Faster than llama.cpp, vLLM, and NVIDIA TensorRT-LLM. Is one developer + Ai really better than the entire industry?

🚀 A high-performance, GPU-accelerated (NVIDIA CUDA 13.2) Dev Container for Machine Learning and Deep Learning. Features Python 3.12 (uv), Node 22 (fnm), JupyterLab, and Docker-in-Docker, keeping your host system 100% clean.