r9700

LLM speculative inference server for heterogeneous hardware & consumer GPUs

The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server.

vLLM for AMD RDNA4 (gfx1201): Radeon AI PRO R9700 & RX 9070 XT — native MXFP4 linear kernel + spec-decode verify fix, carried as rebased branches (fork-carry model)

App to handle one GPU to multiple models/element with queuing and log tracking all with a local hosted web dashboard

Minimal AITER LDS and ROCr idle-CPU fixes for Radeon AI PRO R9700 on vLLM 0.29.0 / ROCm 7.2.3

Experimental ROCm 10 compatibility build for Qwen3.8-Flash-Next on 4x AMD R9700

Verified dual-R9700 deployment recipe, configs, scripts, and benchmarks for Dyluhn/R9V Qwen3.8 Flash-Next

Working on the fastet vllm path for AMD Radeon AI PRO R9700

Instrumented AMD R9700 inference with numerical alignment, qualified performance backports, persistent chat snapshots and Pi integration. Downstream of Radiance.