A new framework called Rep2Text shows that a single hidden vector inside an LLM leaks about half the words of its input, raising privacy and interpretability questions.
A new open-source annotator fills the gap between behavior labeling and bounding-box tracking, producing training data for interaction detection models.
A single adaptive drafter adjusts speculative decoding to batch size and hardware, posting up to 2.99x throughput on vLLM and 3x single-request speedups.
OpenAI added a 12-hour time-to-live option to API prompt caching, letting persistent agents keep shared instructions, tools, and context cached across the full workday.
Google and Meta ship a native PyTorch backend for TPUs with true eager execution, torch.compile, vLLM and SGLang support, and near-linear scaling to full pods.
Anthropic let an internal Claude model run a 64-hour autonomous protein design campaign, producing 17 lab-validated binders against scorpion neurotoxins from four regions.
Perplexity's agent now runs the model, planner, and tool execution entirely on Apple silicon, keeping private files and credits off the cloud entirely.