DeepSeek V4 Flash's second day beat its first: the tooling caught up and the real caveats surfaced.
Top Signal
llama.cpp tool-calling fix lands — rerun your DeepSeek V4 Flash tests
platform change
r/LocalLLaMA, HN Front Page, Simon Willison
DeepSeek V4 Flash 0731 dropped yesterday; today the local stack caught up and the picture changed. A llama.cpp fix for the model's tool calling merged (PR #26269), resolving the looping and malformed-call behavior that made early self-hosted runs look broken — anyone who benchmarked before roughly 12 hours ago has bad numbers. Real hardware figures also arrived: a single 40GB A100 runs the Q8 quant at ~17.7 tok/s with all experts on CPU, an RTX 3090 + 128GB DDR5 hits 12.5 tok/s on UD-IQ3_S, and dual 3060s + 96GB manage 3.5 tok/s on IQ2_M. Unsloth shipped MXFP4 and DwarfStar MTP-head GGUFs. The caveat worth heeding: multiple users report it still ignores system rules, skills, and style prompts regardless of phrasing or language. Do this: pull llama.cpp main before you evaluate, and keep it out of prompt-governed agent workflows until the rule-following reports resolve.
Read more →
Fast Signals
Microsoft publishes Flint, a chart language aimed at LLM authorship
new tool
HN Front Page
Flint is a visualization language explicitly pitched at the AI era — a grammar meant to be emitted by models rather than hand-written by analysts. If you currently have an LLM generating Vega-Lite or raw plotting code behind a schema-validate-and-retry loop, a narrower target grammar is the cheaper fix. Worth a spike before you tune another retry prompt.
Link →
Cursor strips cost data from its usage page and CSV export
platform change
HN Front Page
Cursor's usage page and CSV export now show token counts without cost information. Any team doing per-feature or per-customer spend attribution just lost its source data. Snapshot whatever history you still have and move cost tracking to your own gateway or proxy logs — this is the second vendor-side reporting rollback this quarter.
Link →
Agent-to-human Slack pings fail socially, not technically
workflow
Simon Willison
Greg Brockman notes that OpenAI staff hook ChatGPT into Slack, and colleagues react badly when a coworker's agent messages them — even for work they'd happily do if a person asked. The bottleneck for agent-initiated workflows is consent and attribution, not capability. If you ship agents that contact humans, design the disclosure before the capability.
Link →
datasette-agent lets agent tools run code in the user's browser
workflow
Simon Willison
The 0.4a0 release adds `await context.browser_task()`, so an agent tool can execute directly in the user's browser instead of on the server. That is a clean pattern for anything needing local state, DOM access, or the user's own session credentials without proxying them through your backend. Steal the pattern if your agent should act as the user, not as your service.
Link →
Two labs claim novel research wins — both in verifiable domains
research to practice
Simon Willison
OpenAI published ten claimed advances in mathematics and theoretical CS, days after Anthropic reported Claude finding real cryptographic weaknesses. The builder read is the shape, not the results: both wins came in domains with cheap mechanical verification. If you can build a checker for your task, model-driven search is now a viable strategy; if you can't, this pattern doesn't transfer.
Link →
ripgrep musl builds segfault on very large searches
platform change
HN Front Page
An open ripgrep issue documents musl-linked binaries segfaulting during very-large searches. That's a live hazard for agent harnesses that shell out to `rg` from Alpine containers — it presents as a flaky tool, so it gets misdiagnosed as model behavior. Check whether your image ships the musl or glibc build.
Link →
EU AI Act transparency rules take effect August 2
platform change
r/LocalLLaMA
As of tomorrow, AI-generated text, images, audio and video served to EU users must be marked as machine-generated. This is the rare policy item with a code change attached — provenance metadata or visible labeling in your output path. If you have EU users, it belongs in this week's sprint, not in a legal review queue.
Link →
Radar
Tomte: a fast Gemma 4 harness for Apple Silicon
A solo dev shipped a free Gemma 4 harness for M-series Macs, on the thesis that people undervalue Gemma because the harnesses around it are slow. Worth ten minutes if you tried Gemma locally and blamed the weights.
Link →
30+ small domain-specific benchmarks for local models
A growing community collection of narrow, task-specific benchmarks for local models rather than another general leaderboard. Useful when you need to pick one model for one job instead of ranking the whole field.
Link →
reverse-skill: a router over a large agent skill library
A trending repo that routes AI coding clients to security-research skills on demand and bootstraps each skill's toolchain only when invoked. Ignore the domain — the router-plus-lazy-toolchain pattern generalizes to any skill library too big to load into context.
Link →
Lean postmortem on a kernel soundness bug
Leo de Moura published a postmortem on soundness bug #14576 in the Lean kernel. If your plan for trusting AI-generated code is "the proof checker verifies it," this is a useful calibration on how large that trusted base actually is.
Link →
LongCat-Flash-Lite-Sparse weights are now downloadable
Meituan's sparse LongCat variant moved from announcement to actual weights, with community MTP-equipped builds following the same day. Another data point in this week's pattern of sparse mid-size models aimed at consumer RAM budgets.
Link →
Convergence Watch
deepseek v4 flash
TRENDING
21 mentions across r/LocalLLaMA, HN Front Page, Simon Willison
Second consecutive day across three sources, and source count rose from two to three. The conversation shifted from benchmark scores to deployment mechanics: quant selection, tool-calling fixes, tokens-per-second on specific hardware. That shift is the reliable signal that a model is actually being used rather than discussed.
kimi k3
TRENDING
3 mentions across HN Front Page, r/LocalLLaMA
Sixth day in the window, but the role changed. K3 now appears as the quality ceiling others get compared against and as the stress target for streaming inference engines, not as something people deploy. Expect mentions to keep decaying as V4 Flash absorbs the practical workload.
harness design
TRENDING
5 mentions across r/LocalLLaMA, Simon Willison
A 22-point accuracy swing from harness changes alone, Gemma 4 failing file edits on text-match errors, a tool-calling patch flipping V4 Flash from broken to usable, and smevals explicitly evaluating harnesses. Four independent observations of the same claim: at current model quality, the scaffold is the variable with the most headroom left.
STALE: Latent Space newest item is >48h old