Speculative decoding#3

Merged

varad-more merged 16 commits into

mainfrom

speculative-decoding

Apr 20, 2026

Commits on Apr 9, 2026

Added runs for variance testing
varad-more
committed

Commits on Apr 10, 2026

Decode Length Sweep for gemma2 and phi4 mini
Ubuntu
committed

Commits on Apr 15, 2026

added decode length sweep runs for gemma and phi4
Ubuntu
committed

Commits on Apr 17, 2026

completed decode length sweep and partial concurrency runs
varad-more
committed

Commits on Apr 18, 2026

completed phase 2 concurrency-64 runs for all 8 cells
varad-more
committed
add idempotent resume logic for phase 1 variance and phase 3 decode-sweep top-up
varad-more
committed

Commits on Apr 19, 2026

Commits on Apr 20, 2026