4B model hits 87% coding benchmarks; CLI-Anything makes every shell tool agent-native; MTP's hidden VRAM trick.
Top Signal
4B coding agent hits 87% on benchmarks—here's the architecture
workflow
r/LocalLLaMA
A builder on r/LocalLLaMA documented achieving 87% benchmark performance on coding evals using only a 4B parameter model. The post title promises the 'how'—implying the gains come from agent architecture rather than raw scale: likely structured tool use, retrieval-augmented context management, and iterative self-correction loops that let a small model punch far above its weight class. This inverts the common assumption that coding agent quality requires frontier-scale models. If a 4B model can hit 87% with the right scaffolding, the cost/performance curve for local and embedded agentic coding drops dramatically—and private codebases stay private. **Action:** Read the architecture breakdown and extract the scaffolding patterns, specifically how context is managed and how the agent decides when to retry vs. escalate. These patterns are model-agnostic and apply regardless of what model you're currently using.
Read more →
Fast Signals
CLI-Anything makes every shell tool agent-native
new tool
GitHub Trending
HKUDS/CLI-Anything wraps any command-line interface so AI agents can call it as a structured tool with no custom integration code. It ships with a CLI-Hub registry of pre-wrapped tools at clianything.cc. If your agent currently requires bespoke wrappers for every shell utility, this collapses that scaffolding layer to near-zero.
Link →
Dograh: self-hostable open-source Vapi/Retell replacement
new tool
GitHub Trending
Dograh is a drag-and-drop voice agent platform you can self-host—positioned as a direct alternative to Vapi and Retell, with a workflow builder and sub-2-minute claimed setup time. If you're paying Vapi's per-minute pricing or need data sovereignty for voice agents in production, this is worth a serious eval now.
Link →
MTP KV cache quantization is free VRAM recovery
workflow
r/LocalLLaMA
The MTP draft layer in llama.cpp ships with its own KV cache that most users leave at full precision—wasting VRAM. Quantizing it with `-cache-type-k-draft q8_0 -cache-type-v-draft q8_0` recovers headroom at no quality cost. Combined with the updated llama.cpp (post-May 16 fix), users are now reporting 1.5–2.44× throughput on Qwen3.6 27B across Strix Halo and RTX 3090 rigs.
Link →
Anthropic acquires Stainless, the SDK generator behind its own SDKs
platform change
HN Front Page
Stainless auto-generates idiomatic SDKs from OpenAPI specs and already produces Anthropic's official Python and TypeScript client libraries. The acquisition signals Anthropic is treating SDK quality as core infrastructure. Expect tighter API/SDK consistency and potentially auto-generated SDKs shipping same-day as new API features.
Link →
Sx: brew-style package manager for AI skills and MCP servers
new tool
HN Show
Sx (sleuth-io/sx) is a CLI tool that installs, updates, and manages AI skills, MCP servers, and slash commands across Claude Code, Cursor, and Copilot from a shared registry. Still early, but if MCP/skill ecosystems fragment further, a shared install layer becomes load-bearing infrastructure. Watch alongside tech-leads-club/agent-skills for convergence signals.
Link →
Andon Labs: 4 AI agents ran a radio station autonomously—here's what broke
research to practice
HN Front Page
Andon Labs ran a live experiment with 4 AI agents programming and operating an FM radio station with no humans in the loop, then published a failure post-mortem. It's a rare documented case study of continuous multi-agent deployment in a real environment. Bookmark if you're designing autonomous agent systems that must operate without human supervision.
Link →
Radar
oMLX beats other MLX engines for Apple Silicon inference
Community benchmarks show oMLX outperforming LM Studio and other MLX wrappers for local inference on Apple Silicon. Worth testing if you're using MLX-based local inference and haven't revisited your engine choice recently.
Link →
Voice AI vulnerable to hidden adversarial audio attacks
IEEE Spectrum documents how adversarial audio embedded in background noise can hijack voice AI systems and redirect their behavior. If you're shipping voice agents in public-facing contexts, audit your audio input pipeline before this becomes an active exploit template.
Link →
Cloudflare Project Glasswing: frontier models for real-time cyber defense
Cloudflare published findings from Mythos, their AI cyber-threat detection experiment, signaling that inference-at-the-edge for real-time security decisions is advancing past lab stage. Relevant if you're building anything touching network security, bot detection, or edge inference pipelines.
Link →
Convergence Watch
multi-token prediction
TRENDING
6 mentions across r/LocalLLaMA, r/LocalLLaMA, r/LocalLLaMA, r/LocalLLaMA, r/LocalLLaMA, r/LocalLLaMA
MTP in llama.cpp has moved past the 'it landed' moment and into operational refinement—KV cache quantization, backend shootouts (ik_llama.cpp winning on 24GB VRAM), and hardware-specific tuning are now dominating local inference discussion. The PSA to update llama.cpp confirms early builds had bugs that masked real gains. If you're running Qwen3.x locally, MTP + current llama.cpp is the new default recommended stack.
agent skill registries
2 mentions across HN Show, GitHub Trending
Sx (package manager) and tech-leads-club/agent-skills (validated registry) appeared independently today, three days after Anthropic's skills standard went public. Three independent signals in one week suggest the 'agent skill ecosystem layer' is consolidating rapidly. The open question is whether these registries federate or fragment—watch for one gaining critical adoption mass.