Topic

#Speculative Decoding

2 articles on Speculative Decoding — news, releases, guides and analysis from the DevClubHouse engine.

Tutorial 2d ago 0

Run a Fast, Fully Local Coding Agent on macOS

Ditch the cloud and run Gemma 4 locally with llama.cpp and speculative decoding for blazing-fast terminal assistance.

Rachel Goldstein

Xiaomi's MiMo-V2.5-Pro-UltraSpeed Pushes a 1T Model Past 1000 Tokens/Sec on Commodity GPUs

Through FP4 quantization, block-level speculative decoding, and the TileRT system stack, Xiaomi claims trillion-parameter decode speeds normally reserved for custom silicon — on a single 8-GPU node.

News · 6d ago5

Speculative Decoding in your inbox

The best developer & AI content, delivered. No spam.