MTP goes mainstream: 80+ tok/s on 12GB VRAM is the new baseline for local inference.
Top Signal
BeeLlama.cpp Combines DFlash + TurboQuant for 2-3x Local Speedups
new tool
r/LocalLLaMA
A new llama.cpp fork called BeeLlama.cpp integrates DFlash speculative decoding with TurboQuant's lossless 4.25 bpv KV cache compression, adding reasoning and vision support. On a single 3090, Qwen 3.6 27B Q5 hits 135 tok/s peak at 200K context — 2-3x faster than baseline llama.cpp. This matters because it collapses the stack: you no longer need separate optimizations for speed, context length, and quantization. The combo of DFlash draft models + compressed KV cache means consumer GPUs can handle production-grade context windows. If you're running local inference for coding agents or RAG, test BeeLlama.cpp against your current llama.cpp setup. The 200K context at speed changes what's feasible for agentic workloads on a single card.
Read more →
Fast Signals
80 tok/s on 12GB VRAM: MTP + Qwen 3.6 35B-A3B Recipe Shared
workflow
r/LocalLLaMA
A detailed config for running Qwen3.6-35B-A3B with llama.cpp MTP on a 12GB GPU achieves 80 tok/s with 128K context and 80%+ draft acceptance rate. The key is using IQ4_XS quants with the MTP PR and tuning -ncmoe for MoE block offloading. This is the clearest evidence yet that MTP transforms consumer GPU viability for large MoE models.
Link →
"LLMs Corrupt Your Documents When You Delegate" — New Research Paper
research to practice
HN Front Page
A paper hitting 324 points on HN shows systematic ways LLMs introduce subtle corruption when editing documents — not hallucination, but semantic drift during delegation. For builders using LLMs in editing pipelines (docs, code review, content), this is a concrete risk. Worth reading before you trust LLM-in-the-loop document workflows without diff review.
Link →
HTML Over Markdown for LLM Output Hits HN Front Page + Simon Willison
workflow
Simon Willison, HN Front Page
Thariq Shihipar from Anthropic's Claude Code team argues HTML is strictly better than Markdown as an LLM output format — richer layout, no ambiguity, and Claude Code generates it well. Simon Willison amplified it. If you're building tools that consume LLM output, consider requesting HTML instead of Markdown to get more structured, renderable results.
Link →
OpenAI's WebRTC Problem: Why Voice AI Needs a New Transport Layer
platform change
HN Front Page, Simon Willison
A 463-point HN post explains why WebRTC drops audio packets aggressively to maintain latency — which destroys LLM prompts mid-stream. If you're building voice AI, WebRTC's assumptions about acceptable data loss are fundamentally misaligned with language model input. The post advocates for MoQ (Media over QUIC) as the replacement transport.
Link →
AWS Releases AI-DLC: Workflow Steering Rules for Coding Agents
new tool
GitHub Trending
AWS Labs published aidlc-workflows — a set of adaptive lifecycle rules that steer AI coding agents through development phases (plan, implement, test, review). Rather than prompt engineering, it's structured control flow for agent behavior. If you're building or customizing coding agents, this is a reusable governance layer worth forking.
Link →
Flutter Team Ships Official Agent Skills for Flutter Development
emerging signal
GitHub Trending
Google's Flutter team released flutter/skills — curated agent instructions for happy-path Flutter development workflows. This is notable as the first major framework team shipping official agent skill definitions rather than just docs. If you maintain a framework, this is the template for making your project agent-friendly.
Link →
Radar
CloakBrowser: Stealth Chromium Passing All Bot Detection
A drop-in Playwright replacement with source-level fingerprint patches that passes 30/30 bot detection tests. If you're building scrapers or browser automation for agents, this solves the detection arms race at the browser level rather than per-request.
Link →
vLLM ROCm Added to Lemonade as Experimental Backend
AMD's inference story gets another piece: vLLM ROCm is now available as a Lemonade backend. For AMD GPU owners, this simplifies the serving stack significantly. Watch for whether this closes the CUDA gap for production inference.
Link →
Sarvam MoE Architecture Support Lands in llama.cpp
A PR adding sarvam_moe architecture to llama.cpp signals new MoE model families beyond Qwen/DeepSeek entering the local inference ecosystem. Worth watching for model diversity on consumer hardware.
Link →
Convergence Watch
multi-token prediction
TRENDING
5 mentions across r/LocalLLaMA, GitHub Trending, HN Front Page
MTP has moved from experimental PR to daily-driver optimization in one week. Multiple independent reports confirm 1.5-2.5x speedups on consumer GPUs with Qwen 3.6 and Gemma 4. The technique is now production-viable — if you're running local inference and haven't tested MTP, you're leaving free performance on the table.
local agentic coding
TRENDING
4 mentions across r/LocalLLaMA, GitHub Trending, HN Show
Seven consecutive days of multi-source mentions. The convergence of MTP speedups, MoE models fitting in 12GB VRAM, and agent harness proliferation means local coding agents are crossing the usability threshold. The bottleneck has shifted from model quality to harness/workflow tooling.
agent skills pattern
2 mentions across GitHub Trending
Flutter's official agent skills release follows last week's GitHub Trending + HN Show convergence. Framework teams are now shipping agent-native interfaces alongside traditional APIs — a structural shift in how developer tools will be consumed.
html over markdown for llm output
2 mentions across Simon Willison, HN Front Page
Second day of cross-source discussion. The Anthropic team member's advocacy plus Simon Willison's amplification signals this may become a best practice for LLM output formatting in tool-building contexts.
STALE: Latent Space newest item is >48h old