Gemma 4 QAT lands with benchmarks showing speed + VRAM gains at zero quality cost — grab the GGUFs.
Top Signal
Gemma 4 QAT drops: faster, lighter, no quality loss
research to practice
HN Front Page, r/LocalLLaMA
Google's Gemma 4 quantization-aware training (QAT) models are now live via Unsloth GGUFs (12B, 26B-A4B, 31B). Unlike post-hoc quantization, QAT bakes quantization error into training — the model learns to compensate before weights are compressed. Community benchmarks on AMD 7900 XTX confirm: faster inference AND lower VRAM than standard GGUF variants with no measurable quality regression. If you're running Gemma 4 locally, this is a straight swap with material gains — grab Unsloth's QAT collection on HuggingFace, follow their guide, update your serving config. Critical companion PSA in today's feed: Gemma 4 12B silently breaks all function/tool calls with the default chat template. A community-contributed fix exists (linked in the r/LocalLLaMA PSA post) — mandatory before any agentic use of the 12B.
Read more →
Fast Signals
pg_durable: durable execution baked directly into Postgres
new tool
HN Front Page
Microsoft open-sources pg_durable, a PostgreSQL extension that adds retryable, resumable workflow execution inside the database — no Temporal, no Celery, no external orchestration layer. For agent pipelines already on Postgres, this eliminates a dependency tier for retry-with-state semantics. 277 HN points, 72 comments; worth evaluating before standing up a separate orchestration service.
Link →
Lowfat: 91.8% token reduction on CLI output as agent hook
new tool
HN Show
Single-binary CLI filter that strips verbose output before it reaches LLM context — works as an agent hook or shell wrapper with a per-command plugin system. Install it between your agent and noisy tools (npm, pip, docker). The 91.8% figure is the author's own workload; the approach is sound for any agentic workflow drowning in CLI verbosity.
Link →
Gemma 4 12B tool calls silently broken — custom template required
platform change
r/LocalLLaMA
Default chat template causes all function/tool calls to fail in Gemma 4 12B; agentic harnesses like OpenCode simply don't work. A community-contributed template fix resolves it — linked in the PSA post. Required reading before using Gemma 4 12B in any tool-calling or agentic context.
Link →
Ladybird bans public PRs: AI noise killed the good-faith signal
emerging signal
Simon Willison, HN Front Page
Ladybird browser is closing all public pull requests, explicitly because AI-generated patches destroyed the 'patch size = effort = good faith' heuristic maintainers depended on. First major OSS project to make this call publicly. Builders maintaining OSS libraries or reviewing external contributions should audit their own intake gates — the signal-to-noise problem will compound.
Link →
llama.cpp server hot-swaps models in under 30 seconds
workflow
r/LocalLLaMA
Underknown feature: llama.cpp's server supports live model swapping with no restart, completing in under 30 seconds. If you're routing between local models (coding vs. reasoning vs. general), you don't need separate server instances. Relevant for anyone building multi-model local routing architectures.
Link →
OpenLumara: hand-written, token-efficient agent framework for local models
new tool
r/LocalLLaMA
Modular agent framework built from scratch (explicitly not vibecoded) with a minimal system prompt, targeting local models. Every component is swappable; token efficiency is a first-class design constraint. Early-stage, but worth evaluating if LangChain or AutoGen feel too heavy for your local model setup.
Link →
last30days-skill: multi-source research agent across Reddit/X/YT/HN/Polymarket
new tool
GitHub Trending
GitHub Trending today: an agent skill that synthesizes recent coverage of any topic across Reddit, X, YouTube, HN, and Polymarket into a grounded summary. Immediately useful as a research tool; also worth studying as a reference implementation for multi-source synthesis agent design.
Link →
Radar
dots.tts 2B: SOTA TTS from RedNote
RedNote (Chinese social platform behind TikTok) drops dots.tts 2B, claiming SOTA TTS performance at a compact size. Two SOTA open-source TTS models in two consecutive days — the local voice synthesis space is moving fast.
Link →
KVarN implemented in llama.cpp fork — benchmarks look promising
Community dev ported the Huawei KVarN paper (3-5x KV cache compression) to a llama.cpp fork and ran KLD benchmarks — results are encouraging. Not in mainline yet. Watch for a PR; if quality holds, this stacks on top of the QAT story as another VRAM reduction lever.
Link →
Did Claude increase bugs in rsync?
An independent analysis of Claude's rsync contributions studying whether AI-assisted commits correlate with higher bug rates — 261 HN points, 253 comments. The methodology matters for any team assessing AI coding risk in quality-critical codebases.
Link →
Convergence Watch
gemma 4 qat
TRENDING
6 mentions across HN Front Page, r/LocalLLaMA
Yesterday: 'confirmed imminent,' 1 source. Today: live, with 6+ posts across HN and LocalLLaMA covering benchmarks, Unsloth GGUFs, a tool-call template fix, and hints of at least one additional model variant. Gemma 4 QAT is now the local inference community's primary optimization story, with Unsloth as the canonical distribution point.
qwen3.6
2 mentions across r/LocalLLaMA
Sixth consecutive day in the feed, but today appearing mainly as the comparison baseline in Gemma 4 QAT benchmarks rather than on its own merits. If this pattern continues, Gemma 4 QAT may be beginning to displace it as the local MoE daily driver.