A 2.8T model streams off four SSDs, and your inference engine choice just cost you 7x on TTFT.
Top Signal
deltafin streams Kimi K3 (2.8T) off four SSDs at 1 tok/s on a MacBook
new tool
HN Front Page
deltafin is a small repo that runs Kimi K3 — a 2.8-trillion-parameter MoE — on a single MacBook Pro by streaming expert weights from four consumer SSDs instead of holding them in RAM or VRAM. It hits roughly 1 token/s. That number sounds useless until you notice what it replaces: the assumption that model size sets a hard hardware floor. For sparse MoE architectures, only a fraction of experts fire per token, so the bottleneck moves from memory capacity to storage bandwidth and prefetch scheduling — a problem you can throw $400 of NVMe at rather than $40,000 of GPUs. What to do: don't rebuild your serving stack on this, but if you have batch or offline workloads (evals, dataset labeling, overnight synthesis) where latency is irrelevant and frontier-scale quality matters, this is now a real option. Read the prefetch strategy even if you never run it — the same trick applies to any MoE you already host.
Read more →
Fast Signals
Same model, three engines: 35s vs 258s to first token at full context
workflow
r/LocalLLaMA
A hands-on comparison runs Qwen3.8-Flash-Next through llama.cpp, SGLang, and FreeToken at full context and finds a 7x spread in time-to-first-token, driven by in-flight PRs rather than model config. If you benchmarked your engine choice more than a month ago, that result is stale. Re-run your own long-context TTFT numbers before you blame the model.
Link →
Navier-Stokes dispute puts a provenance question on hosted coding agents
workflow
HN Front Page, r/LocalLLaMA
Two mathematicians say they fed a year of unpublished drafts into Codex, then OpenAI announced a result on the same problem days before their planned publication. The facts are contested and unresolved. The operational takeaway is independent of who is right: if your work has priority or IP value before publication, treat hosted agent context as disclosed, and route that work through local models or zero-retention endpoints.
Link →
Mercury 2.5 pushes diffusion LLMs further into production territory
platform change
HN Front Page
Inception Labs shipped the next Mercury, a diffusion-based language model rather than an autoregressive one — the architecture that generates tokens in parallel passes instead of left to right. The pitch remains latency: diffusion decoding trades some quality headroom for throughput. Worth a real evaluation if you run high-volume, latency-sensitive completion work where a frontier model is overkill.
Link →
Qwen3.8 27B quants: 4-bit holds up, 1-bit collapses
research to practice
HN Front Page, r/LocalLLaMA
A systematic quantization sweep lands on HN with a clean result — 4-bit stays close to full precision on the tested tasks while 1-bit falls apart. This is the third independent quant study on this model family in a week, and they agree, which is the useful part. Stop hunting for the exotic sub-3-bit win and default to 4-bit.
Link →
A 400MB model on a 2017 phone drives a real desktop Chrome
workflow
r/LocalLLaMA
Someone wired Qwen3-0.6B running on a Samsung Note 8 to a full desktop Chrome session and got working browser control. The lesson is that the model is not the hard part of computer-use agents — the harness, action space, and DOM representation are. If your agent needs a 70B to click buttons, the harness is doing too little work.
Link →
Two agent-native headless browsers trend the same day
new tool
GitHub Trending
lightpanda ships a headless browser built from scratch for AI and automation workloads, while camofox-browser offers a drop-in Puppeteer/Playwright replacement aimed at sites that block automated clients. Independent projects, same premise: Chromium-via-Playwright is the wrong substrate for agents at scale. If you run browser agents, benchmark lightpanda against your current stack for memory and cold-start cost.
Link →
Copperhead brings agent-assisted editing to circuit board design
new tool
HN Front Page
A Show HN pitching "Cursor for circuit boards" — LLM-driven editing inside PCB layout. This is the applied counterpart to last week's EEBench result that agents mostly cannot design boards yet, and the interesting question is whether a tight editing loop closes that gap where autonomous generation failed. Bookmark if you touch hardware; the same copilot-over-autopilot pattern is the safer bet in any domain with expensive physical output.
Link →
Radar
Infercat: share a local model over an encrypted p2p tunnel
A solo-dev tool that exposes your local inference server to friends via an invite code and an encrypted peer-to-peer tunnel, no port forwarding or reverse proxy. Useful if you want a small team on one GPU box without standing up auth and TLS yourself.
Link →
An interactive attention visualizer for LLMs
A browser-based tool that renders attention patterns over a prompt, aimed at intuition rather than research plots. Worth an hour if you debug prompt behavior and have never actually watched where a model looks.
Link →
Qwen-Drive-1.0-4B puts driving perception in 4B open weights
Qwen released a 4B model targeted at autonomous driving, an unusual domain-specific drop from a lab that mostly ships general models. Signals that vertical open-weight models at edge-deployable sizes are becoming a normal release format.
Link →
Nex-N2.5-mini lands a 35B from an unfamiliar lab
A 35B open-weight release from nex-agi, a name with no track record in most builders' rotation. Nothing proven yet, but the 30-40B band is where single-GPU deployment lives, so it is worth a benchmark pass before dismissing it.
Link →
A GPU buying guide indexed on GB-per-dollar and bandwidth
A comparison table ranking cards by memory per dollar and memory bandwidth rather than headline FLOPS — the two numbers that actually gate local inference. Keep it open the next time you spec a box.
Link →
Convergence Watch
qwen3.8
TRENDING
4 mentions across r/LocalLLaMA, HN Front Page
Seven straight days of mentions, now spanning quantization studies, engine benchmarks, and agentic coding demos on both HN and r/LocalLLaMA. The conversation has shifted from whether the model is good to how to deploy it well — the reliable sign a model has become default infrastructure rather than news.
agentic browser control
TRENDING
3 mentions across GitHub Trending, r/LocalLLaMA
Two independent agent-native headless browsers trended alongside a demo of a 0.6B model driving desktop Chrome, continuing yesterday's desktop-control thread. The center of gravity is moving from bigger models to better harnesses and purpose-built runtimes. If you build browser agents, the substrate under you is being replaced right now.
ai research provenance
3 mentions across HN Front Page, r/LocalLLaMA
OpenAI's Navier-Stokes announcement, the mathematicians' contested priority claim, and a follow-on data-poisoning discussion all surfaced within hours across two sources. Regardless of how the dispute resolves, it is pushing a concrete practice question into the open: what unpublished work is safe to put in a hosted agent's context window.
STALE: Latent Space newest item is >48h old