Claude Sonnet 5 ships today; local builders crack 100 TPS on a single 3090 with speculative decoding.
Top Signal
Claude Sonnet 5 ships — read the developer changelog now
platform change
Simon Willison
Anthropic released Claude Sonnet 5 today. Simon Willison's first stop is always the official 'what's new' developer page at platform.claude.com/docs/en/about-claude/models/whats-new-sonnet-5 — and that should be yours too. Sonnet is the model driving the majority of production agentic pipelines; any changes to context window, extended thinking behavior, tool use surface, or pricing have immediate downstream effects on architecture decisions you're making this week. Don't rely on secondhand summaries for this one — the changelog is the primary source. Check it before your next sprint: capability additions often unlock prompt patterns or API features you can adopt same-day. If you're pinned to claude-sonnet-4-6 in any config file, evaluate whether the upgrade path is worth it now rather than discovering breaking changes later.
Read more →
Fast Signals
shot-scraper 1.10: agents can self-record video demos via storyboard YAML
new tool
Simon Willison
New `shot-scraper video storyboard.yml` command captures browser sequences as video — designed explicitly for having agents document their own work. Define steps in YAML, get a video output. Immediately useful for shipping agent demos, building QA audit trails, or stakeholder walkthroughs without any separate screen recording setup.
Link →
Qwen 3.6 27B hits ~100 TPS on a single RTX 3090 via speculative decoding
workflow
r/LocalLLaMA
Community benchmark tested 5 speculative decoding configurations on Xeon E5-2666v3 + 64GB RAM + single RTX 3090 24GB, reaching ~100 tokens/sec. The recipe is hardware-specific and replicable today. If you run 27B-class local inference and haven't tuned your speculative decoding setup, this is your reference point.
Link →
Hugging Face launches hardware compatibility filter for model search
platform change
r/LocalLLaMA
HF now lets you filter the model hub by your specific hardware — eliminates the trial-and-error loop of downloading models that won't fit your VRAM or architecture. Practical quality-of-life change; use it next time you're evaluating base models for fine-tuning or local deployment.
Link →
NVIDIA drops official NVFP4 quant of Qwen3.6-27B
new tool
r/LocalLLaMA
NVIDIA published nvidia/Qwen3.6-27B-NVFP4 on HuggingFace — their own 4-bit format optimized for Ada/Hopper architectures. More trustworthy provenance than community quants for production workloads. Worth benchmarking against bartowski GGUF variants on your hardware.
Link →
TurboOCR v3: self-hosted C++/CUDA OCR at 520 img/s, fully local
new tool
r/LocalLLaMA
TurboOCR v3 upgrades to PP-OCRv6 models, doubling throughput from ~270 to ~520 img/s on RTX 5090 (lower on older cards). Self-hosted, no cloud dependency, C++ core. If you're building document ingestion pipelines that need high-volume OCR without per-call API costs, this is the benchmark to run.
Link →
Huawei open-sources OpenPangu-2.0-Flash: 92B MoE, 6B active, Ascend-trained
new tool
r/LocalLLaMA
OpenPangu-2.0-Flash is a 92B-total / 6B-active MoE model trained on Ascend NPUs, hosted on ai.gitcode.com (not yet on HuggingFace). Two independent posts today. Non-Western hardware training lineage makes it worth adding to your eval suite if you're tracking efficiency-class MoE alternatives.
Link →
Microsoft silently pulls FastContext-1.0-4B-SFT from HuggingFace and GitHub
platform change
r/LocalLLaMA
FastContext — a 4B model focused on long-context efficiency — has been quietly removed from both HuggingFace and GitHub with zero explanation. If any pipeline you own depends on this model, mirror what you have now. Treat silently-removed hosted weights as a reminder: never take a hard dependency on weights you don't control.
Link →
Radar
HydraHead: head-level attention hybridization from Qwen team
Qwen's research team published HydraHead — specialized attention hybridization applied at the individual head level rather than the layer level. If this pattern ships in future Qwen releases, it could improve long-context retrieval without full architecture changes. Watch the paper before it shows up as a surprise capability bump.
Link →
Norm-preserving abliteration: 0% refusal, benchmarks intact, open dataset
Community technique applied to Qwen3.6-35B-A3B achieves full refusal removal while preserving benchmark performance — with an open-source dataset for replication. Standard abliteration degrades quality; this variant claims to avoid it. Worth tracking if you need uncensored models for internal or agentic tooling.
Link →
council-of-high-intelligence: 18 AI personas, one /council command
Low-star GitHub repo that spins up 18 AI personas (Feynman, Torvalds, Kahneman, etc.) across multiple LLM providers for structured multi-round deliberation via a single CLI command. The underlying pattern — genuine model diversity for adversarial review — is worth stealing for architecture decisions or prompt red-teaming.
Link →
Convergence Watch
qwen 3.6 27b
TRENDING
4 mentions across r/LocalLLaMA, HN Front Page
Qwen 3.6 27B has been the dominant local model discussion for 3+ consecutive days, appearing across HN and r/LocalLLaMA. Today it picked up two concrete builder artifacts: an official NVIDIA NVFP4 quant and a replicable ~100 TPS speculative decoding benchmark on a single 3090. Community has converged — this is the current 27B-class reference model.
speculative decoding
TRENDING
3 mentions across r/LocalLLaMA, HN Front Page
Speculative decoding has appeared across 4 of the last 7 days with rising mention counts. It's moved from theory to replicable recipe: today's Qwen 3.6 27B benchmark at ~100 TPS on a single 3090 is the most concrete result yet. If you're running 27B+ models locally and haven't added a speculative draft model, this week is the right time to try.
SOURCE DOWN: HN Front Page returned 0 items
STALE: Latent Space newest item is >48h old