Skip to content

feat(llama-cpp-localai-paged): paged KV cache llama.cpp backend + cross-request prefix sharing + GB10 decode optimization [WIP]#10462

Draft
localai-bot wants to merge 145 commits into
masterfrom
worktree-feat+paged-attention
Draft

feat(llama-cpp-localai-paged): paged KV cache llama.cpp backend + cross-request prefix sharing + GB10 decode optimization [WIP]#10462
localai-bot wants to merge 145 commits into
masterfrom
worktree-feat+paged-attention

Commits

Commits on Jun 19, 2026

Commits on Jun 20, 2026

Commits on Jun 21, 2026

Commits on Jun 22, 2026

Commits on Jun 23, 2026

Commits on Jun 24, 2026

Commits on Jun 25, 2026

Commits on Jun 26, 2026

Commits on Jun 27, 2026