A 125B model now streams off SSD onto a 48GB Mac — while quant filenames keep lying about what's inside.
Top Signal
slotstream streams a 104GB model off SSD onto a 48GB Mac
new tool
HN Front Page
slotstream is a Mac-native runner (MLX + Swift) that executes Qwen3.8-Flash-Next 4-bit — a 125B-parameter, ~104GB model — on Macs starting at 16GB of unified memory, hitting ~12 tok/s on a 48GB machine. It works by expert-offloading and SSD-streaming: only the active MoE experts are resident, the rest page in from disk, with an auto-mode that sizes the resident set to your hardware. This is the practical answer to the RAM-price squeeze that has dominated local-inference chatter for a week: instead of buying 192GB, you trade idle NVMe bandwidth for capacity. What to do: if you have an M-series Mac and have been priced out of big-MoE local inference, install it and benchmark against your current 27B-class setup — the quality-per-token jump from a 125B model may beat the tok/s loss. Verify SSD write amplification before running it all day on a soldered drive.
Read more →
Fast Signals
AtomicChat's Qwen3.8-Flash-Next quants aren't what the filenames say
emerging signal
r/LocalLLaMA
A teardown alleges AtomicChat's popular Qwen3.8-Flash-Next GGUFs are labeled at bit-widths they don't actually carry — which is why they 'fit when unsloth's can't' and run faster. This is the second quant-provenance scandal in five days after the 443-file audit. Check tensor-level bit-widths yourself before you attribute a quality regression to the base model.
Link →
Kaitchup benchmarks Qwen3.8-27B from Q4 all the way down to Q1
research to practice
r/LocalLLaMA
A full sweep of Qwen3.8-27B quantization levels with measured scores, not vibes — the reference for deciding how far down you can push before quality collapses. Pair it with the AtomicChat story: the curve only means something if your file's real bit-width matches its label. Bookmark for your next VRAM-budget decision.
Link →
Qwen3.8-27B hits 2,000 tok/s prefill and 132 tok/s decode on one 3090
workflow
r/LocalLLaMA
An independent dev's tuned inference stack now claims 2,000 tok/s prefill and 132 tok/s decode on a single RTX 3090 with minimal quality loss, and says decode is maxed out until a better drafter appears. That's agent-loop territory on $700 of used hardware. Worth replicating if you're running batch pipelines locally.
Link →
Multi-token-prediction GGUFs land for Qwen3.8-Flash-Next
new tool
r/LocalLLaMA
MTP weights are now published for Qwen3.8-Flash-Next-GGUF, extending last week's MTP releases to the model most people are actually running. MTP gives free decode speedup via self-speculation without a separate draft model. Re-pull your quants and enable the MTP path in llama.cpp before you tune anything else.
Link →
OpenAI's Codex desktop app quietly ships a whole LibreOffice
workflow
Simon Willison
Simon Willison found a bundled LibreOffice sitting in the Codex desktop app's cache — a shipping agent product solving document conversion by embedding a headless office suite rather than calling an API. That's a copyable pattern and a reminder to audit what your own agent binaries drag along. Steal the approach for local docx/xlsx handling.
Link →
Anthropic ships Claude Fable 5.1 and Mythos 5.1
platform change
HN Front Page
Point releases of both frontier models, with a what's-new doc and system card. Treat this as an eval trigger, not news: re-run your regression suite before switching, since 5.1 behavior changes tend to show up in tool-calling and long-agent-run reliability rather than benchmark scores.
Link →
World Labs releases Atlas, a world model for spatial intelligence
research to practice
HN Front Page
A foundation model for 3D/spatial reasoning rather than text — the concrete follow-through on last week's 'we have foundation models for language, not for physics' complaint. Not shippable in a normal LLM app today, but the first credible target if you're building anything that reasons about space, layout, or navigation.
Link →
Radar
wrapture: monkeypatching, done as a real abstraction
Graham Dumpleton (wrapt, mod_wsgi, New Relic's Python agent) has released a successor library for wrapping and instrumenting Python code. If you're building tracing or eval interception around an LLM SDK you don't control, this is the mature primitive.
Link →
minimind: train a 64M-param LLM from scratch in 2h
Trending repo that walks the full pretrain-to-SFT pipeline on a single consumer GPU in an afternoon. The fastest way to build real intuition about tokenizer, data mix, and loss behavior before you spend money on a fine-tune.
Link →
Spark-X2.5 4B/1.7B drop; unlabeled Gemmas appear on Arena
Two new sub-5B open models land the same day unidentified Gemma checkpoints show up in Arena testing. The small-model tier is churning weekly now — worth a re-benchmark if you run anything on-device.
Link →
Nori: a $1,688 bimanual mobile robot for developers
A YC-backed dev platform at roughly a tenth of typical humanoid research-rig pricing, aimed at people collecting manipulation data. Relevant if the open RL-environment work of the past week has you looking for cheap real-world hardware.
Link →
Ambient CSS v3 brings Blender-style lighting to CSS
A pure-CSS approach to 3D-ish ambient lighting and material effects, no WebGL. Cheap way to make an AI product's UI stop looking like every other Tailwind dashboard.
Link →
Convergence Watch
qwen3.8
TRENDING
7 mentions across HN Front Page, r/LocalLLaMA
Sixth consecutive day at the center of the local-inference conversation, now spanning quantization audits, a 3090 speed record, MTP weights, and a Mac SSD-streaming runner. The tooling ecosystem — not the model release — is where the movement is. Qwen3.8 is effectively this cycle's default local base model; optimize your stack for it.
gguf quantization quality
TRENDING
3 mentions across r/LocalLLaMA
Third flare-up in six days: after the 443-file audit and the UD 3.0 quality claims, a specific publisher is now accused of mislabeling bit-widths. Meanwhile builders are asking why nobody ships INT8 W8A8 for the 3090's native tensor cores. Filename trust is broken — verify tensor-level bit-widths before benchmarking anything.
ram prices
TRENDING
2 mentions across r/LocalLLaMA, HN Front Page
Intel hinting at re-entering the memory business is the sixth straight day of memory-supply signal, after Micron's HBM wafer math and pre-sold DDR5 stock. The market response is showing up as software: SSD streaming and expert offloading are being built specifically to route around RAM you can't buy. Plan capacity assuming prices stay bad through Q4.
STALE: Latent Space newest item is >48h old