audio.cpp collapses a dozen TTS runtimes into one binary — and WebGPU just hit 1,400 tok/s in-browser.
Top Signal
audio.cpp: 12 audio models, one ggml binary, 5x faster TTS on CUDA
new tool
r/LocalLLaMA
audio.cpp is the llama.cpp of audio — a single C++/ggml runtime consolidating 12 models (Qwen3-TTS, PocketTTS, VeVo2, and more) with TTS running up to 5x faster than equivalent Python stacks on CUDA. Same philosophy as llama.cpp: eliminate Python overhead, unify model loading, ship one binary. If you're building voice agents or audio pipelines today, you're likely managing separate Python runtimes per model with their associated latency and dependency drag. audio.cpp collapses that surface dramatically. The 5x CUDA speedup is the headline, but the real win is operational: one dependency, one interface, a dozen models. Actionable now: swap your Python TTS stack, benchmark against your current stack, and check which of the 12 supported models fits your voice quality/latency tradeoff. Especially compelling for real-time voice agents where Python overhead was the bottleneck.
Read more →
Fast Signals
DESIGN.md: Google Labs spec for handing design systems to coding agents
workflow
GitHub Trending
Google Labs shipped a format spec — DESIGN.md — that gives coding agents a persistent, structured understanding of visual identity: typography, color tokens, component rules, brand voice. Think CLAUDE.md but for design systems. As agentic codegen matures beyond logic into UI, agents need design context that survives context resets. Drop a DESIGN.md in your repo root and start testing whether it reduces agent design drift.
Link →
LFM2.5 230M hits 1,400 tok/s in-browser via custom WebGPU kernels
research to practice
r/LocalLLaMA
Liquid AI's 230M model is running at 1,400 tok/s entirely in the browser using hand-tuned WebGPU kernels — not just 'it runs' but genuinely fast. This is the emerging benchmark for on-device inference with no server required. If you're building zero-backend or privacy-first inference, WebGPU with custom kernels is now the path, and this is the reference implementation to study.
Link →
New sampler+verifier brings 0.5B coding performance to ~2-4B class
research to practice
r/LocalLLaMA
A new sampler+verifier technique claims to dramatically boost tiny 0.5B model coding performance with no weight changes — potentially on par with 2-4B class models — and may reduce hallucinations 30-50% on larger models. Zero cost to test if you're already running the model. Mandatory read if you're constrained to edge-deployable sizes.
Link →
Gemma4-QAT uncensored adds MTP: 35–53% speed boost, free upgrade
platform change
r/LocalLLaMA
Gemma4-QAT variants now ship with Multi-Token Prediction, delivering 35% throughput boost on the 26B-A4B and 53% on the 31B-QAT — no quality tradeoff. Gemma4-QAT has been in this briefing three days running; MTP integration is the new development. If you're running either size locally, upgrade now.
Link →
NVIDIA Nemotron-TwoTower-30B: diffusion-based LM architecture ships
emerging signal
r/LocalLLaMA
NVIDIA released a diffusion-style language model on the Nemotron backbone — not autoregressive, not a standard transformer decoder. This makes two major labs (NVIDIA + Mercury Coder) now shipping diffusion-based text generation. The architecture enables the parallel decoding speedups NVIDIA has been claiming. Not ready to swap your inference stack, but this is the architecture to understand before it lands in production tooling.
Link →
JetSpec: parallel tree drafting hits 9.64x lossless speculative decoding
research to practice
r/LocalLLaMA
New research paper demonstrates parallel tree drafting — exploring multiple draft token branches simultaneously — to achieve 9.64x lossless speedup and 1000+ TPS with speculative decoding. This is the third independent speculative decoding advancement in a week (after Eagle3 and NVIDIA's parallel claims). The technique is becoming the dominant inference optimization vector.
Link →
stablyai/orca: desktop ADE for managing fleets of parallel coding agents
new tool
GitHub Trending
Orca is an 'Agent Development Environment' that lets you run any coding agent (Claude Code, Codex, custom) under your own API subscription, coordinating parallel agents from a desktop or mobile app. Early-stage, but represents the tooling layer forming above individual agent binaries. Worth bookmarking as the category matures.
Link →
Radar
BatonBot: local Kanban for async AI coding agent workflows
Open-source local-first app for managing coding agent tasks without babysitting each step — Kanban board, task queue, check-in gates. Addresses a real friction point with local models where the feedback loop requires constant human intervention. Worth watching as agentic coding workflows mature past single-session interactions.
Link →
interviewstreet/hiring-agent: PDF resume → explainable score pipeline
Open-source agent pipeline: extract structured data from PDF resumes, enrich with GitHub activity signals, output a fair explainable evaluation score. A concrete reference implementation of a document-to-structured-output agentic pipeline with multi-source enrichment. Useful as an architectural template beyond the hiring use case.
Link →
simonw/browser-compat-db: MDN compatibility as queryable SQLite
Simon Willison packaged MDN's browser compatibility data as a SQLite database, inspired by the new MDN MCP server. Lets you query 'does X CSS property work in Safari 17?' locally or via MCP. Useful for any agent pipeline generating frontend code that needs to verify cross-browser support without hitting the network.
Link →
Convergence Watch
glm-5.2
TRENDING
1 mentions across r/LocalLLaMA
GLM 5.2 has appeared in every daily feed for 7 consecutive days, peaking at 4 independent sources on June 22. Today's mention is consumer hardware benchmarks (dual RTX 5090, Threadripper Pro), signaling the community has moved from 'does it exist' to 'what can I run it on' — adoption normalization phase.
speculative decoding
TRENDING
1 mentions across r/LocalLLaMA
Three independent speculative decoding advances in one week: Eagle3 (June 19-20), NVIDIA parallel decoding (June 23), JetSpec today. Different teams, different approaches (draft models, parallel tree drafting, diffusion parallel decoding) all converging on the same outcome: 5-10x inference speedup with no quality loss. This is the dominant inference optimization vector right now.
gemma-4-qat
1 mentions across r/LocalLLaMA
Gemma4-QAT has been in the feed for 3 consecutive days. Today's addition of MTP (35-53% speed boost) is a concrete new development rather than repeat coverage. If you've been watching this model family, today's MTP integration is the trigger to actually deploy it.
SOURCE DOWN: HN Show returned 0 items