A vendor benchmark survives an outside audit, and a free inference endpoint quietly dies inside your CI.
Top Signal
Independent 445-trial run reproduces V4 Flash's 82.7% Terminal-Bench
research to practice
r/LocalLLaMA
DeepSeek claimed 82.7% on Terminal-Bench 2.1 for V4 Flash 0731 using "DeepSeek Harness minimal mode" — a scaffold that has never been released. The author of the Ante harness re-ran the evaluation on a public harness across 445 trials and landed on the same number. That matters more than the score itself. Vendor agent benchmarks are normally unfalsifiable because the harness is the product: prompt format, tool schemas, retry policy, and context trimming can swing terminal-agent results by double digits. This is one of the few cases where an open-weights coding model's headline number survived contact with someone else's scaffold. If you are choosing a model for terminal or coding-agent work, V4 Flash now has verified evidence behind it, and the reproduction gives you a public harness to benchmark your own scaffold against instead of trusting a vendor's. Run your task set through it before committing.
Read more →
Fast Signals
GitHub Models is retired — your Actions workflows will fail silently
platform change
Simon Willison
GitHub shut down its Models inference endpoint on July 30; Simon Willison only found out when a scheduled Actions run in his research repo errored. If you used the free GitHub Models endpoint for CI-time inference, evals, or scheduled scraping jobs, those jobs are broken right now. Grep your workflows for the endpoint and repoint them at a real provider.
Link →
code-graph-rag: knowledge-graph retrieval built for monorepos
new tool
GitHub Trending
Trending repo that parses a multi-language monorepo into a knowledge graph, then serves queries and edits against it instead of doing flat embedding chunk retrieval. This is the fix for the failure mode where a coding agent can't find a caller three packages away. Point it at a repo where naive RAG has been losing cross-file context.
Link →
KLQ hits W4A4KV4 with no training and no GPTQ rounding
research to practice
r/LocalLLaMA
KLQ is a training-free measured rotation quantization method that beats SpinQuant and other training-free rotation approaches at 4-bit weights, activations, and KV cache, approaching ReSpinQuant without LDLQ/GPTQ rounding. Training-free matters operationally: no calibration pipeline, no fine-tune budget. Worth testing if you are serving quantized models where activation and KV precision is your bottleneck, not weights.
Link →
Speculative decoding applied inside the tool-call span
workflow
r/LocalLLaMA
Tool-call arguments are the most predictable tokens a model emits — rigid JSON schemas, repeated field names, echoed parameters — which makes them near-ideal draft targets. This report applies speculative decoding specifically to the tool-calling portion of generation rather than to prose. If your agent loop is dominated by structured calls rather than reasoning text, this is latency you are currently leaving on the table.
Link →
Simon Willison prototypes compressed text history in SQLite
workflow
Simon Willison
Working prototypes for storing document revision history in a relational database without exploding storage — delta chains and compression schemes benchmarked against each other. Directly relevant if you are versioning agent-edited documents, prompt revisions, or memory files and have been reaching for a full VCS. Read the README before you build your own diff table.
Link →
WeatherNext 2 ships as an open model with DeepMind's code
new tool
GitHub Trending, r/LocalLLaMA
Google DeepMind published the global medium-range forecasting model — including prior-generation models — with code, and it surfaced independently on both GitHub Trending and r/LocalLLaMA today. Its cyclone forecasts reportedly bought forecasters an extra day of lead time. A domain-specific open weights release with real deployed value, not a chatbot: useful template if you are building vertical models outside language.
Link →
Radar
SupraElegans-500K: a 500K-param model with no attention
An experimental causal language model built on a sparse, signed, recurrent neural graph — no transformer, no attention mechanism. Almost certainly not useful yet, but architectural experiments this far off the transformer path are where genuinely new scaling behavior tends to show up first.
Link →
Lophius: a workbench for language model research
From the developer behind Heretic, a tooling layer aimed at model internals research rather than inference serving. Worth bookmarking if you do ablations, activation steering, or refusal-direction work and have been gluing scripts together by hand.
Link →
harvey-labs: an open benchmark for legal agents
Harvey open-sourced a benchmark for evaluating agent performance on legal work — a vertical where task decomposition and citation grounding are the hard parts. Useful as a structural reference even if you build in a different regulated domain.
Link →
Tencent announces Hunyuan3D WorldClaw
New 3D world model from Tencent's Hunyuan group, announced with a demo site but no weights yet. Tencent has open-weighted most of the Hunyuan3D line, so watch for a weights drop rather than acting on the announcement.
Link →
Convergence Watch
deepseek v4 flash
TRENDING
1 mentions across r/LocalLLaMA
Fourth appearance in seven days, but the character of coverage changed: earlier days were vendor numbers and price cuts, today is third-party verification on a public harness. That shift — from claim to reproduction — is when a model becomes safe to build on.
quantization
TRENDING
1 mentions across r/LocalLLaMA
Fifth day in the last seven. The frontier has moved from weight-only quantization to joint weight/activation/KV schemes at 4 bits, and increasingly training-free. If your quantization playbook is still Q4_K_M and nothing else, it is roughly a month stale.
weathernext
2 mentions across GitHub Trending, r/LocalLLaMA
Appeared on two independent sources on release day. Weak convergence — a single release surfacing twice rather than a technique spreading — but notable as the local-model community pulling non-language open weights into its orbit.
STALE: Latent Space newest item is >48h old