Mistral's extreme-sparse MoE lands, audio.cpp goes GGML-native, and ctx solves agent amnesia.
Top Signal
Mistral drops Leanstral-1.5: 119B total, only 6B active (MoE)
new tool
r/LocalLLaMA
Mistral released Leanstral-1.5-119B-A6B — a 119B MoE model with only 6B active parameters per forward pass. That's a ~20:1 sparsity ratio: frontier-scale routing intelligence at approximately 7B inference cost. If quality holds, this resets the economics for both hosted and local inference — you get a model trained on 119B parameters while paying for a 6B serving footprint. The 'A6B' suffix (6B active) puts it in the same inference-cost tier as Mistral 7B while accessing far more learned capacity through routing. Immediate builder move: benchmark it against your current 7–14B workhorse on your specific tasks. GGUF quantizations should appear on HuggingFace within 24–48 hours. Watch for quality degradation on the sparse routing path under quantization — that's the failure mode to probe.
Read more →
Fast Signals
audio.cpp: 10-min music locally in 60s, full GGML-native stack
new tool
r/LocalLLaMA
audio.cpp dropped C++/GGML native ports of ACE-Step, Stable Audio, HeartMuLa, RoFormer, and HTDemucs today — 10-minute music tracks generated in ~60 seconds locally. This is the same no-Python, no-deps model that llama.cpp established for LLMs, now applied to generative audio with source separation (HTDemucs) included. If you're building audio pipelines, evaluate this before committing to hosted APIs.
Link →
ctx: ranked full-text search over your local agent transcripts
new tool
HN Show
ctx ingests coding agent transcripts (Claude Code, Cursor, etc.) from your local machine into SQLite and enables ranked text search. Directly addresses agent amnesia — months of full-fidelity session history on your disk becomes searchable memory. Actionable today if you've accumulated agent sessions and keep re-solving the same problems in new contexts.
Link →
DeepSeek V4 Flash: Sonnet quality, local speed, 1M context patched
emerging signal
r/LocalLLaMA
Real-world follow-up: V4 Flash on 2x RTX PRO 6000 completes coding tasks faster than Sonnet and Opus at approximately Sonnet quality. Separate post shows a llama.cpp patch enabling 1M token context on an RTX 5090 by fixing the DSA lightning indexer's VRAM explosion. The model ships as MXFP4 — unusual native quantization worth understanding before deployment.
Link →
OpenAI ships Codex plugin for Claude Code
platform change
GitHub Trending
openai/codex-plugin-cc lets you call Codex directly from inside Claude Code for code review or parallel task delegation. Two leading AI coding environments are now interoperable. If you're Claude Code-native, you can now use Codex as a second opinion or offload subtasks without switching contexts.
Link →
Claude Code team: let the agent judge its own output first
workflow
Simon Willison
Simon Willison reports a tip from the Claude Code team at AIE: prompt your agent to evaluate whether its own output meets your requirements before you review it. Simple workflow change — agent runs its own acceptance criteria post-task. Reduces review cycles measurably and works with any agent that can be given explicit success criteria upfront.
Link →
SwiReasoning cuts token count and latency on Qwen 3.6 27B
workflow
r/LocalLLaMA
Community reports SwiReasoning applied to Qwen 3.6 27B produces dramatically more direct answers with far fewer tokens — lower total latency despite slightly slower tok/s. The technique appears to restructure the reasoning path rather than just sampling differently. Worth testing on your Qwen 3.6 inference stack; may generalize to other reasoning models.
Link →
Radar
Particle Scattering Sampler: new llama.cpp experimental sampler
Community fork adds a 'scatter' sampler to llama.cpp that slightly smooths next-token probability distribution — targeting repetition reduction without the incoherence of high temperature. Too early to evaluate empirically, but if it merges upstream it becomes a new inference lever.
Link →
agentskills: standardized spec for agent skill packaging
GitHub trending repo proposes a standardized format for packaging and distributing AI agent capabilities as installable 'skills'. No critical mass yet, but if adopted this could become the npm-equivalent for agent tooling — worth a bookmark to watch traction.
Link →
caveman: 65% token reduction via terse prompt style in Claude Code
GitHub trending Claude Code skill that instructs the model to respond in minimal 'caveman' syntax, empirically cutting ~65% of tokens in coding sessions. Amusing framing with a real result — relevant if you're running long agentic sessions against token budgets or cost caps.
Link →
Convergence Watch
deepseek v4 flash
TRENDING
5 mentions across r/LocalLLaMA
Multiple independent posts today show V4 Flash matching Sonnet quality at local speeds on consumer/prosumer hardware, plus a llama.cpp patch unlocking 1M context. Community is converging on this as the practical local coding model. Appeared in entities 2026-07-01; benchmark data is now concrete enough to act on. The MXFP4 native format is the key technical variable to probe.
gemma 4 31b
TRENDING
5 mentions across r/LocalLLaMA
Community stress-testing continues: narrow fine-tune yielding +290 Elo for copywriting tasks, a rebuild attempt as 26B via SWA layer ablation, and an avatar demo. Gemma 4 31B is the current community playground — fine-tuning experiments are running ahead of any official Google variants, which is an early signal about community consensus on the base model quality.
glm-5.2
TRENDING
2 mentions across r/LocalLLaMA
Appearing in 4+ of the last 7 days. Today's follow-up resolves the MTP mystery and confirms ~24 tok/s at 128K context on 4x DGX Sparks. Still a high-hardware story ($5+ GPU setup), but the sustained community investigation suggests real quality signals worth tracking once quantized variants reach accessible hardware.