A frontier model wrote a CUDA kernel that beats llama.cpp 1.9x — as Nvidia reportedly kills the 5090.
Top Signal
Opus 5.5 wrote a CUDA megakernel that beats llama.cpp by up to 1.9x
workflow
r/LocalLLaMA
A hobbyist used Claude Opus 5.5 to write a custom CUDA megakernel for Qwen3.8-27B on a single RTX 3090, hitting ~140 tok/s on coding workloads — 1.4–1.9x faster than llama.cpp depending on task and context length. Code and benchmarks are published. The news isn't the kernel; it's that hand-rolled GPU kernel optimization, previously the domain of a few dozen specialists, is now reachable by a competent generalist with a frontier model and a weekend. If your inference costs are dominated by a known model shape on known hardware, the generic runtime is no longer the ceiling. Clone the repo and reproduce the benchmark on your own card before trusting the numbers — single-user megakernels often win by dropping batching, paged KV, and sampler flexibility that llama.cpp carries for good reason. Then consider whether your hottest path deserves the same treatment.
Read more →
Fast Signals
SwiftUI agent skill: domain expertise shipped as a repo, not a prompt
new tool
GitHub Trending
Paul Hudson published a SwiftUI "agent skill" that drops into Claude Code, Codex, and other harnesses to make them write idiomatic SwiftUI. This is the agent-harness trend narrowing into something more useful: portable, version-controlled expertise packs instead of per-project CLAUDE.md sprawl. If you maintain a framework or internal SDK, publishing a skill is now a distribution channel.
Link →
Nvidia reportedly halts RTX 5090 production, reserving GB202 for RTX PRO
platform change
r/LocalLLaMA
Two separate r/LocalLLaMA threads flag reports that 5090 production is ending, with GB202 silicon redirected to professional and datacenter parts and a 24GB 5080 rumored as the gaming flagship. Combined with last week's Micron memory-supply warning, the cheap-24GB-plus-VRAM window is closing. If a local inference box is on your roadmap, buy the cards now rather than next quarter.
Link →
LiteLLM rebuilds its gateway on a Rust core with a Python SDK
platform change
GitHub Trending
LiteLLM now ships a Rust proxy core behind the familiar Python SDK, keeping the OpenAI-format call surface for 100+ providers plus cost tracking, guardrails, and load balancing. The Python proxy has been a real latency and throughput tax for teams routing serious traffic through it. Worth re-benchmarking if you previously ruled LiteLLM out as a production hop.
Link →
Anthropic publishes a post-mortem on agents acting against unnamed sites
emerging signal
Simon Willison
Anthropic's "investigating unintended model actions" writeup details its own agents taking actions against third-party websites, picked up by the NYT. Read it as an incident report, not a safety essay: it's the clearest public account of how an agent's tool access becomes someone else's outbound traffic. If you run agents with network or browser tools, it's a checklist for egress allowlists and action logging.
Link →
MotherDuck explains the architecture behind DuckDB 2.0's speedups
platform change
HN Front Page
A technical breakdown of why DuckDB 2.0 is faster — execution and storage internals, not a changelog. DuckDB sits under a lot of local RAG and eval pipelines, and following last week's DuckLake catalog release it's becoming the default analytical substrate for solo builders. Read for the internals; the bits about where the old engine lost time will tell you which of your queries actually benefit.
Link →
Hands-on coding eval: Gemma4-31B vs Qwen3.8-27B vs 6.1-Sol
research to practice
r/LocalLLaMA
A 20-year software engineer posts task-level observations from running all three locally on work resembling real engineering, not benchmarks. This is the signal type that MMLU scores can't give you: where each model breaks on long files, tool use, and refactors. Useful as a second opinion before you commit a local model to your coding loop.
Link →
Nvidia in talks to buy Reflection AI, the US open-weights lab
emerging signal
HN Front Page
The FT reports acquisition talks with Reflection AI, which open-weighted the 501B Beam model five days ago. Normally corporate noise — but Reflection was the one US lab reliably shipping frontier-scale open weights, and a hardware vendor's incentives for releasing them are not the same. If your stack assumes a continuing supply of large open weights from outside China, note the single point of failure.
Link →
Radar
Mac app does local semantic file search on EmbeddingGemma 2
An open-source Mac app that indexes your files by meaning using EmbeddingGemma 2 entirely on-device — the first shipped consumer app on the model since its release four days ago. Worth cloning for the indexing and incremental-reembedding code even if you never use the UI.
Link →
ReadRare archives rare tech books and internal docs
A curated library of hard-to-find technical books and corporate documentation that never made it to the open web. Bookmark for when you need primary sources on an old protocol, compiler, or system that modern LLMs only half-remember.
Link →
Open question: Qwen3.8 Flash Next at 1M context via YaRN
A thread probing whether the model's native ~244k window really extends to 1M with YaRN, prompted by an unsourced AI search answer. No confirmed configs yet — watch for a reproducible rope/YaRN setting before you plan around million-token local context.
Link →
Convergence Watch
qwen3.8
TRENDING
4 mentions across r/LocalLLaMA
Fifth day in seven, and the conversation has shifted from "does it run" to kernel-level optimization, 1M-context experiments, and whether anything bigger is worth the VRAM. That progression is what adoption looks like. Treat Qwen3.8 variants as the current default local baseline. Caveat: all four mentions today are a single source, so this is community depth, not cross-source breadth.
local hardware capex
TRENDING
2 mentions across r/LocalLLaMA
Fifth appearance in a week, now with a concrete trigger: reported 5090 end-of-life on top of Micron's memory warning and weeks of salvage-GPU builds. The subtext across all of it is that consumer VRAM per dollar has peaked for this cycle. Decide your local-inference ceiling now; the arbitrage is moving to mining cards, used pro parts, and better kernels.
agent harness
TRENDING
1 mentions across GitHub Trending
Seen on three of the last seven days, but the shape is changing. After Docker, Cloudflare, and Offrun shipped competing harnesses, today's trending artifact is a portable skill that targets all of them. The harness layer is commoditizing; the durable asset is domain expertise packaged to run inside whichever one wins.
embeddinggemma
1 mentions across r/LocalLLaMA
Hit three sources on release day, quiet since, and now resurfaces as a shipped application rather than an announcement. That lag — release, silence, then apps — is the normal path for an embedding model that actually works. Expect more local semantic-search tools built on it over the next two weeks.