Latency is a topic tracked in our intelligence system with 5 linked articles.
Solana cuts mainnet slot time to 350ms (from 400ms) as the first step toward a 200ms target, reducing latency without boosting throughput; three more 50ms cuts are planned, with validators rotating faster and epoch duration shrinking accordingly.
A technical deep-dive into vLLM's high-throughput inference stack, covering core architecture (engine core, KV cache, paged attention), advanced features (chunked prefill, prefix caching, guided and speculative decoding, disaggregated P/D), multi-GPU scaling (Uniproc/MultiProc, TP/PP/DP), distributed serving, and latency/throughput benchmarking with concrete configs and code sketches.
Google’s Gemini 3.6 Flash and 3.5 Flash-Lite aim to cut latency and token costs for enterprise AI agents.
Outlook's new version reportedly introduces a latency of about 10 seconds for tasks that Outlook Classic executes instantly, implying a potential performance regression.
ZeroDrift raised a $10M seed to operate as an AI governance layer between models and users, using deterministic compliance checks and LLM rewrites to curb problematic outputs with claimed latency advantages.
HN thread: a data-center contractor finds a node with a CC- style serial prefix on legacy networking gear, reports unusual 0.4 ms RTTs and an unregistered 46.28.x.x block, and asks if this prefix is known or what it implies.
Subscribe for real-time topic updates and unlimited access to our intelligence platform.