Popular repositories Loading

1. llama.cpp-turboq-mtp llama.cpp-turboq-mtp Public

   Forked from Indras-Mirror/llama.cpp-turboq-mtp

   Fused TBQ4 Flash Attention + MTP + Shared Tensors for llama.cpp — 82+ tok/s with lossless 4.25 bpv KV cache at 200K context on RTX 4090

   C++