Prefill latency beats decode speed for agent performance — new benchmark rewrites model selection.
Top Signal
Prefill, not decode, dominates agentic workloads — KV heads beat param count
research to practice
r/LocalLLaMA
A community benchmarker ran 13 local models through 65K–128K context agentic tasks (tool use, coding agents, RAG) and surfaced two findings that reframe model selection. First: prefill latency dominates total wall-clock time in agentic loops — far more than decode speed, which most builders optimize for. A model that prefills 2x faster saves more time than one that decodes 2x faster. Second: KV head count beats raw parameter count for quality at long context — models with more GQA heads maintained coherence better than larger models with fewer heads. Actionable: when choosing a model for production agent pipelines at 65K+ context, evaluate prefill tok/s and KV head architecture before benchmark scores or parameter count. This directly applies to anyone running RAG pipelines or multi-step coding agents where context windows are large and tool calls are frequent.
Read more →
Fast Signals
Supra-Router-51M + Reasoning Summarizer: two tiny agent pipeline tools
new tool
r/LocalLLaMA
Same developer shipped two purpose-built tiny models in one day: Supra-Router-51M routes prompts to the right model tier at negligible overhead, and Supra Reasoning Summarizer condenses coding agent thinking traces into readable summaries. Both fill real gaps in multi-model pipelines — cheap routing and trace legibility are unsolved problems in most agentic setups. Drop-in additions worth testing.
Link →
Codex rewrites DeepSeek V4 Flash MLX kernels: 1.6x prefill, 3x decode
workflow
r/LocalLLaMA
A developer used Codex to rewrite 8-bit MLX inference kernels for DeepSeek V4 Flash on a Mac Studio and got 1.6x prefill speedup and 3x decode speedup. The workflow is the signal: describe the bottleneck, let the coding agent propose low-level changes, benchmark. AI-assisted kernel optimization is now practical for individuals without deep CUDA or Metal expertise.
Link →
sqlite-utils 4.0rc2: $149.25 to complete an OSS release with Claude Fable
workflow
Simon Willison
Simon Willison shipped sqlite-utils 4.0rc2 with Claude Fable handling the bulk of coding work — total cost $149.25 in API spend on a Max subscription. First concrete published dollar-amount for AI-assisted OSS library development at release quality. Useful calibration data for estimating AI development costs on comparable projects.
Link →
unity-mcp: MCP server gives AI assistants direct Unity Editor control
new tool
GitHub Trending
CoplayDev released an MCP server that lets any AI coding assistant manage Unity assets, edit scripts, control scenes, and automate Editor tasks. If you're building game AI tooling or want a coding agent to drive Unity workflows end-to-end, this is the integration layer that was missing. Trending on GitHub.
Link →
Longcat 2.0 (1.6T MoE, ~48B active) opens under MIT
platform change
r/LocalLLaMA
Previously stealth-released as Owl-Alpha, the 1.6T MoE model is now fully open under MIT — ~48B active parameters. Worth benchmarking if you need a large MoE that outscales 70B-class models while keeping open weights. Weights are downloadable now.
Link →
terax-ai: 7MB terminal-first AI dev workspace
new tool
GitHub Trending
Terax is a lightweight (7MB) terminal-native AI workspace — no cloud, no heavy IDE, designed for developers who live in the terminal. Minimal-footprint alternative to Cursor or VS Code AI integrations. Bookmark for projects where environment constraints or latency rule out heavier tooling.
Link →
claude-skills: 337-skill community library trending on GitHub
new tool
GitHub Trending
A community-maintained collection of 337 Claude Code skills is trending — 30+ agents, 70+ custom commands covering engineering, product, compliance, and C-level advisory use cases. Largest public reference library of skill patterns for Claude Code integrations; useful both as a drop-in resource and as a study guide for how to structure skills at scale.
Link →
Radar
LivePortrait distilled: 25fps face animation in browser via WebGPU
A distilled LivePortrait model runs at 25fps in the browser via WebGPU — no server-side rendering required. Browser-side real-time portrait animation crosses a usability threshold relevant to avatar and video-feature products. Watch this space if you're building client-side multimodal UX.
Link →
Meetily: 100% local meeting assistant built in Rust
Meetily combines 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization in a fully local, no-cloud Rust app trending on GitHub. If you're building meeting intelligence features, this is the open-source reference implementation worth studying for architecture patterns.
Link →
eval-harness: personal evals for agentic CLI harnesses
Community tool for generating personal evaluations tailored to your specific agentic CLI setup — fills the gap between generic public benchmarks and real use-case performance. Worth tracking if you need to measure your agent's task performance systematically rather than relying on published leaderboards.
Link →
Convergence Watch
glm 5.2
TRENDING
4 mentions across HN Front Page, r/LocalLLaMA
GLM 5.2 has appeared across HN Front Page and r/LocalLLaMA for 4 of the last 7 days. Today's data point: FP8 + FP8 KV on H200 hits Terminal-Bench 2.1 score of 79.8. Community is actively benchmarking and finding it competitive with top coding models. If you haven't evaluated it for agentic coding tasks, now is the time.
deepseek v4 flash
TRENDING
5 mentions across r/LocalLLaMA
DeepSeek V4 Flash has sustained 5+ consecutive days of r/LocalLLaMA coverage and is now attracting active kernel optimization work — today's post shows Codex-assisted MLX rewrites yielding 3x decode speedup. The model is landing as the community's local workhorse and the optimization surface is still wide open.
STALE: Latent Space newest item is >48h old