Vectorless RAG drops the embedding step entirely; MTP acceptance rates expose the real speedup math.
Top Signal
PageIndex: Reasoning-Based RAG That Skips Vector Embeddings Entirely
new tool
GitHub Trending
PageIndex from VectifyAI introduces a fundamentally different RAG architecture: instead of chunking documents into vectors and doing similarity search, it builds a structured document index that LLMs navigate through reasoning. The model reads a table of contents, decides which pages are relevant, then reads those pages directly — mimicking how a human would use a reference book. This matters because vector-based RAG has well-known failure modes: semantic similarity doesn't equal relevance, chunk boundaries destroy context, and embedding models add latency and cost. PageIndex eliminates the embedding pipeline entirely. If you're building RAG and frustrated by retrieval quality, this is worth prototyping against your current pipeline. The approach trades compute (more LLM calls) for accuracy, which increasingly favors builders as inference costs drop.
Read more →
Fast Signals
re_gent: Version Control System Built Specifically for AI Agents
new tool
HN Show
Show HN project that adds git-like VCS designed for agent workflows — tracking not just what changed but why, with rewind capabilities that survive context compaction. Addresses a real gap: when agents delete folders or make breaking changes, standard git doesn't capture the agent's reasoning. Early-stage but worth watching if you run multi-step agents.
Link →
MTP + TurboQuant: 80+ t/s at 262K Context on a Single RTX 4090
workflow
r/LocalLLaMA
A community dev combined multi-token prediction with TurboQuant's lossless 4.25 bpv KV cache compression on Qwen3.6-27B, nearly doubling throughput from 43 to 80+ t/s while maintaining 262K context on one card. The key insight: MTP's real bottleneck is acceptance rate, not raw speed — another post shows MTP only helps 40% on some workloads where draft tokens get rejected frequently. Test on your actual prompts before committing.
Link →
Gemma 4 DFlash Hits 600 tok/s on Single RTX 5090 via vLLM
workflow
r/LocalLLaMA
z-lab released gemma-4-26B-A4B-it-DFlash, a speculative decoding variant, and benchmarks show 600 tok/s on a single RTX 5090 with vLLM 0.19.2rc1. This is the fastest single-GPU result reported for a model of this class. If you're serving Gemma 4 in production, DFlash + vLLM is now the configuration to beat.
Link →
AI2 Releases EMO: New Open MoE Architecture
emerging signal
r/LocalLLaMA
Allen AI (AI2) dropped EMO, a new mixture-of-experts model. Details still emerging but AI2's track record (OLMo, Tulu) means this is worth tracking. Their MoE work tends to prioritize reproducibility and open training data, which matters if you need models you can audit or fine-tune with full provenance.
Link →
Mojo 1.0 Beta Ships — Python-Speed Syntax, C-Speed Execution
platform change
HN Front Page
Mojo hit 1.0 beta with 261 HN points and 170 comments. The language targets AI/ML workloads with Python-compatible syntax but compiled performance. If you're writing inference pipelines or custom training loops where Python is the bottleneck, this is the milestone to start evaluating seriously.
Link →
Skymizer HTX301: PCIe Inference Card with 384GB Memory at 240W
emerging signal
r/LocalLLaMA
Taiwanese company Skymizer announced a PCIe inference card with 384GB of memory — enough to run full-precision 70B+ models or massive context windows without multi-GPU setups. At 240W it's power-efficient for datacenter deployment. No pricing yet, but this is the memory-density play that local inference builders have been waiting for.
Link →
Radar
CUDA Inference on Apple Silicon via PCI Passthrough
Someone got NVIDIA CUDA inference running on Apple Silicon Macs using PCI passthrough — a technique previously thought impossible without Thunderbolt eGPU support. Niche today, but could unlock hybrid Apple+NVIDIA inference setups for local development.
Link →
HTML Over Markdown for LLM Output Formats
Anthropic's Thariq Shihipar argues HTML is strictly better than Markdown as an LLM output format — richer structure, better rendering, and Claude Code already excels at it. Simon Willison amplified. Worth rethinking if you're defaulting to Markdown in your prompts.
Link →
Convergence Watch
multi-token prediction
TRENDING
4 mentions across r/LocalLLaMA, GitHub Trending
MTP is now in its 4th consecutive day of multi-source coverage. Today's signal: community is moving past hype into practical tuning — acceptance rate, not raw speed, determines real-world gains. TurboQuant + MTP combos are the current frontier. MTP is becoming table-stakes for local inference.
local agentic coding
TRENDING
3 mentions across HN Show, r/LocalLLaMA, GitHub Trending
7th consecutive day across 3+ sources. Today's signal shifts from raw model performance to infrastructure: re_gent (agent VCS), agent harness fatigue (too many frameworks), and Goose moving to a foundation. The stack is maturing from 'can local models code?' to 'how do we manage agent workflows?'
qwen 3.6
TRENDING
3 mentions across r/LocalLLaMA
7th consecutive day. Community has moved past benchmarks into daily-driver optimization: 35B-A3B running on 12GB VRAM, TurboQuant combos for 262K context. Qwen 3.6 is becoming the default local model for resource-constrained builders.
STALE: Latent Space newest item is >48h old