Extends Unsloth to add a Ollama API Proxy server to allow use of tools that don't support Unsloth's native OpenAI API
-
Updated
May 19, 2026 - Python
Extends Unsloth to add a Ollama API Proxy server to allow use of tools that don't support Unsloth's native OpenAI API
Llama-3.2-3B-Instruct distilled on DeepSeek-R1 reasoning traces to think out loud. GSM8K accuracy falls from 75.0% to 65.0% while output length more than doubles — published as a measured negative result, with the per-problem breakdown behind the headline number.
Qwen2.5-3B-Instruct turned into a SQL writer with a 16-bit LoRA. AST-normalised exact match rises from 7.7% to 74.3% on 300 held-out queries, and every output parses as valid SQL. The same cleaning was applied to both models, so the gain is the SQL being right, not the formatting.
Proxy Server that allows Ollama API calls to operate Unsloth
To associate your repository with the unsloth-api topic, visit your repo's landing page and select "manage topics."