JEV stopped being a buzzword today: it runs offline on an M4 at 45 decisions/sec, and people are building their own.
Top Signal
Laya runs open JEV offline on an M4 at 45 decisions per second
emerging signal
HN Front Page, r/LocalLLaMA
Laya, an open implementation of the JEV architecture, now runs fully offline on an M4 Mac through CoreML at ~45 decisions per second, per a gist that hit the HN front page. The same day, r/LocalLLaMA carried a 'DIY Jev' build post and a busy 'What is JEV and what is it used for?' thread — the clearest sign that a technique is spreading faster than its explanation. JEV came out of typesafe.ai's 'system one' framing: small, fast models that make bounded decisions in a loop instead of generating prose. With open drop-ins already shipped (von's 395M, the RLCD-trained horizontal model), you no longer need the vendor to try it. Do this: find the places where your stack pays a frontier model to classify, route, or gate, and benchmark a JEV-class model on that path this week. Laptop-speed decisions change what you can afford to put in a hot loop.
Read more →
Fast Signals
Three weeks, one 3090: an agent's honest CUDA failure report
workflow
r/LocalLLaMA
A local agent loop ran ~21 days on a single RTX 3090 with only ~12 human messages, tasked with building a CUDA inference engine tuned to that GPU. It produced working kernels and benchmarks but never beat llama.cpp. Rare long-horizon telemetry with a negative result — a useful prior for how much unattended agent time actually converts into a win.
Link →
llm-keys-ui: hand API keys to agents on machines you don't shell into
new tool
Simon Willison
Willison's new plugin exists because Codex Remote runs coding agents on boxes where setting an API key by hand is awkward. It gives you a small UI to configure LLM keys on those machines instead. Bookmark it the moment you start running agents on infrastructure you don't interactively log into.
Link →
Pirate Face mirrors LLMs that are disappearing from model hubs
platform change
HN Front Page
A rescue archive for weights pulled from public hubs hit 408 points on HN, arriving days after reports that Hugging Face may be moving against abliterated models. If a specific checkpoint is load-bearing in your product, pull and hash the weights now. A hub URL is not a durable dependency.
Link →
Qwen-Image-2.1 lands, extending the Qwen release cadence to vision
new tool
r/LocalLLaMA
Qwen shipped a new image model, keeping up a release pace that has put a Qwen artifact in front of local builders nearly every day this week. If you have an image generation or editing path, this is the current open baseline to re-benchmark against before renewing a hosted contract.
Link →
Nine local models, one web-dev prompt, one 12GB card
workflow
r/LocalLLaMA
Someone spent ~8 hours running nine LLMs against an identical web-dev prompt on an RTX 3060 12GB and published the side-by-side outputs. Single-prompt evals are weak evidence, but this is calibration data for the most common consumer VRAM tier. Worth skimming before you buy hardware or pick a local coding default.
Link →
A team where the specs, tickets and PRDs are all Claude Code output
emerging signal
Simon Willison
Willison quotes an engineer two weeks into a big-company role: specs, code, tests, PRDs, tickets and their resolutions are all agent-generated, and nobody knows anything. This is the provenance-collapse failure mode arriving in practice, not in theory. Concrete defense: require a human-authored decision record for anything an agent is allowed to write twice.
Link →
Radar
higgsfield: fault-tolerant multi-node GPU training orchestration
An open framework for training billion-to-trillion-parameter models across nodes without hand-rolling the fault tolerance. Niche until the day you outgrow a single box — then it is the problem you least want to solve yourself.
Link →
Codex-X: a GUI for Codex providers, skills and MCP
Cross-platform visual manager for OpenAI Codex desktop/CLI — provider and API switching, session sync, prompt injection, Skills/MCP management, and visual TOML config editing. Chinese-language repo, little English coverage, and it targets exactly the config sprawl that agent setups accumulate.
Link →
A $1k chip that runs exactly one model at 7,000 tok/s
r/LocalLLaMA is seriously debating a Taalas chip with Qwen3.8-27B baked into silicon — fast, cheap, and permanently frozen at that model. Speculative today, but the moment model-on-silicon ships at consumer prices, the build-vs-host calculus for high-volume inference paths inverts.
Link →
Convergence Watch
jev
TRENDING
3 mentions across HN Front Page, r/LocalLLaMA, r/LocalLLaMA
Third straight day of cross-source JEV activity, and today it crossed from announcements to artifacts: a CoreML build running offline, a DIY build post, and a high-traffic 'what even is this' thread. That combination — working code plus widespread confusion — is the window where early adoption still buys you an advantage.
qwen3.8
TRENDING
3 mentions across r/LocalLLaMA
Seven consecutive days on the board, today via a 3-week 3090 agent run, a Flash-Next one-shot demo, and the Taalas chip debate. Caveat: every mention is r/LocalLLaMA. This is depth within one community, not independent corroboration — treat it as the local-inference default, not as validated frontier signal.
local hardware capex
TRENDING
3 mentions across r/LocalLLaMA
The 3090 long-run, the 3060 12GB shootout, and the $1k single-model chip are all the same question: what does a fixed hardware budget actually buy in sustained agent work. The community is shifting from tok/s benchmarks toward cost-per-completed-task, which is the metric worth copying into your own evals.
STALE: Latent Space newest item is >48h old