A small lab retrofitted latent attention onto Qwen3.8-27B and cut the KV cache 4x — no retraining required.
Top Signal
Telperion retrofits MLA/GLA onto Qwen3.8-27B, shrinking KV cache 4x
research to practice
r/LocalLLaMA
Telperion released latent-attention variants of Qwen3.8-27B — Qwen3.8-27B-MLA and Qwen3.8-27B-GLA-g2 — converting the shipped GQA attention into DeepSeek-style multi-head latent attention and gated linear attention, with weights on Hugging Face. The claim: ~4x smaller KV cache, better reasoning efficiency, same base model you already serve. This is the interesting pattern, not just the artifact: attention architecture is becoming a post-hoc retrofit applied to someone else's released weights, rather than something fixed at pretraining. For anyone serving long context on fixed VRAM, KV cache is usually the wall before parameters are — a 4x cut is the difference between 128k and 500k context on one card. What to do: pull the collection and benchmark a retrofit against your current GQA checkpoint on your real context lengths, measuring memory at depth, not just tok/s on short prompts. Verify quality on your eval set — retrofits trade something, and the post is the author's own benchmark.
Read more →
Fast Signals
MiniCPM-V 4.7 demo: 35B multimodal model on a phone in ~3GB
new tool
r/LocalLLaMA
The 35B-A3B version of MiniCPM-V 4.7 is running vision+chat on a handset with roughly 3GB of memory — the sparse-active-params trick finally paying off on mobile silicon. If you have been assuming on-device multimodal means a 1-3B model and degraded output, re-test that assumption this week.
Link →
xtool builds and deploys iOS apps from Linux with SwiftPM
new tool
GitHub Trending
xtool is a cross-platform Xcode replacement that builds and ships iOS apps using SwiftPM on Linux and Windows. That removes the macOS runner from your iOS CI and, more interestingly, lets a coding agent on a Linux box actually compile and deploy an iOS target instead of writing Swift it can never run.
Link →
OpenCode 2.0 lands as the open agentic coding CLI alternative
new tool
HN Front Page
OpenCode shipped a 2.0 and hit the HN front page at 205 points. Worth a look specifically if you want an agent harness you can inspect and point at arbitrary model endpoints, including local ones, rather than a vendor-bound CLI. Read the comments for migration friction before swapping your main loop.
Link →
Anthropic's Scion traces directly to Meta's Mononoke
platform change
HN Front Page, Simon Willison
A teardown shows Scion — Anthropic's Git replacement — is heavily inspired by Mononoke, Meta's Mercurial-based monorepo server. The useful takeaway is that the fix for agent-rate commit volume is a known, 10-year-old monorepo architecture, not a new invention. If your repo is buckling under agent-generated changes, read the Mononoke prior art before building anything.
Link →
AI decompilation of shipped games goes from stunt to wave
emerging signal
Simon Willison
Indie dev Popcar documents a surge of AI-assisted decompilation producing buildable source from shipped game binaries. Treat this as a capability signal with two edges: recovering legacy code you lost the source to is now realistic, and your own shipped binaries are more readable than you priced in.
Link →
Nemotron Bolt 3.5 74B-A9B drops Oct 15
platform change
r/LocalLLaMA
NVIDIA has a 74B-total / 9B-active Nemotron landing tomorrow. The shape matters more than the badge: 9B active means it is a plausible single-GPU-plus-offload workhorse, not a datacenter-only model. Clear VRAM and plan to benchmark it against your current 27-32B dense default.
Link →
inclusionAI ships Ling-3.1-flash open weights
platform change
r/LocalLLaMA
Another open-weight flash-tier release from inclusionAI, now on Hugging Face. Relevant mainly as routing inventory — if you run a gateway with fallbacks, cheap flash-class open weights keep accumulating and the right move is to add it to your eval harness rather than read the card.
Link →
Radar
Tessera-27B-B-CJK rethinks token savings in a finetune
Zellige AI's Qwen finetune claims a novel approach to token efficiency aimed at CJK text. Tokenizer-level savings compound across every request you make, so the technique is worth reading even if you never ship the model.
Link →
Mr.Chatterbox-2.7B trained from scratch on Victorian text
An individual trained a 2.7B chat model from scratch on a single-era corpus — no finetune, no base model. The signal is the cost floor: from-scratch domain pretraining at useful scale is now a hobbyist-budget experiment.
Link →
Jev 1.14.0 from typesafe.ai hits HN with 129 points
A tool most builders have not heard of, shipping "experimental features for dreamers" and drawing real discussion. Low-cost bookmark — check whether it overlaps anything in your type-safety or codegen stack.
Link →
clova.email: inboxes locked to a single sender
Self-creating addresses that bind to the first domain that mails them, killing list resale at the architecture level. A clean pattern to steal for signup and transactional-mail isolation in your own products.
Link →
Convergence Watch
qwen3.8
TRENDING
4 mentions across r/LocalLLaMA
Fifth day running, and the mentions have shifted from "does it run" to third parties modifying it: latent-attention retrofits, CJK token-efficiency finetunes, a PS5 GPU port. Qwen3.8-27B is now the default substrate others build on, which makes it the safest base to standardize local tooling against.
scion
TRENDING
2 mentions across HN Front Page, Simon Willison
Second day across two independent sources, now with new substance: the Mononoke lineage rather than just the announcement. Agent-rate commit volume breaking Git is becoming a real operational category, and the prior art is monorepo server design from Meta.