---
title: "AlphaSignal Infra: Model Serving News"
url: "https://alphasignal.ai/topic/infra/model-serving"
description: "Latest AI and machine learning news about Model Serving (Infra) on AlphaSignal."
---

# AlphaSignal Infra: Model Serving News

Latest AI and machine learning news about Model Serving (Infra) on AlphaSignal.

## Articles

- [Mia AI Lab's sparkDash Watches Your Entire NVIDIA DGX Spark Fleet at Once](https://alphasignal.ai/news/mia-ai-lab-s-sparkdash-watches-your-entire-nvidia-dgx-spark-fleet-at-once.md) (2026-10-06)
- [OpenAI Slashes API Tiers From Five to Three, Cuts Top Threshold in Half](https://alphasignal.ai/news/openai-slashes-api-tiers-from-five-to-three-cuts-top-threshold-in-half.md) (2026-10-06)
- [Meta Opens Rebalancer, Solving 40 Million Daily Infrastructure Problems](https://alphasignal.ai/news/meta-opens-rebalancer-solving-40-million-daily-infrastructure-problems.md) (2026-10-06)
- [Prime Intellect Launches Prime Inference, Serving 600B Tokens Daily](https://alphasignal.ai/news/prime-intellect-launches-prime-inference-serving-600b-tokens-daily.md) (2026-10-02)
- [PyTorch and Red Hat's Helion Beats CUTLASS on H100 by 17.8%](https://alphasignal.ai/news/pytorch-and-red-hat-s-helion-beats-cutlass-on-h100-by-17-8.md) (2026-10-02)
- [Microsoft Ships WSL Containers to Replace Docker Desktop on Windows](https://alphasignal.ai/news/microsoft-ships-wsl-containers-to-replace-docker-desktop-on-windows.md) (2026-10-01)
- [Meta's TLX Beats FlashAttention-4 on Blackwell GPUs by 50%](https://alphasignal.ai/news/meta-s-tlx-beats-flashattention-4-on-blackwell-gpus-by-50.md) (2026-10-01)
- [Artificial Analysis' AA-AgentPerf-Local Shows RTX 5090 Beating 128GB Systems by 5x](https://alphasignal.ai/news/artificial-analysis-aa-agentperf-local-shows-rtx-5090-beating-128gb-systems-by.md) (2026-09-30)
- [Cerebras Beats Human Speed, Booking Restaurants 19x Faster Than Rivals](https://alphasignal.ai/news/cerebras-beats-human-speed-booking-restaurants-19x-faster-than-rivals.md) (2026-09-29)
- [Gimlet Cloud Adds Cerebras to Hit 3,000 Tokens per Second for AI Agents](https://alphasignal.ai/news/gimlet-cloud-adds-cerebras-to-hit-3-000-tokens-per-second-for-ai-agents.md) (2026-09-28)
- [Strata Runs a 125B AI Model on a Regular Gaming PC](https://alphasignal.ai/news/strata-runs-a-125b-ai-model-on-a-regular-gaming-pc.md) (2026-09-28)
- [Mia AI Lab Squeezes a 99 GB Qwen3.8-Flash-Next onto One GPU](https://alphasignal.ai/news/mia-ai-lab-squeezes-a-99-gb-qwen3-8-flash-next-onto-one-gpu.md) (2026-09-25)
- [Edge0 Ships Audio8 ASR Infinite to Transcribe Speech for Hours Straight](https://alphasignal.ai/news/edge0-ships-audio8-asr-infinite-to-transcribe-speech-for-hours-straight.md) (2026-09-25)
- [Liquid AI's LFM2.5-VL DSpark Makes Vision AI 3.13x Faster on Apple Silicon](https://alphasignal.ai/news/liquid-ai-s-lfm2-5-vl-dspark-makes-vision-ai-3-13x-faster-on-apple-silicon.md) (2026-09-24)
- [Databricks Buys Row Zero to Kill the Ungoverned Spreadsheet](https://alphasignal.ai/news/databricks-buys-row-zero-to-kill-the-ungoverned-spreadsheet.md) (2026-09-24)
- [Qwen3.8 Flash Next Runs a 125B Model on Dual V100s at 120 tok/s](https://alphasignal.ai/news/qwen3-8-flash-next-runs-a-125b-model-on-dual-v100s-at-120-tok-s.md) (2026-09-24)
- [Hermes Plugin Hands Agent Triage to Jev in 0.4 Seconds](https://alphasignal.ai/news/hermes-plugin-hands-agent-triage-to-jev-in-0-4-seconds.md) (2026-09-23)
- [Cohere Brings Model Vault to Canada for Enterprises Needing Data Sovereignty](https://alphasignal.ai/news/cohere-brings-model-vault-to-canada-for-enterprises-needing-data-sovereignty.md) (2026-09-23)
- [Meta's Petal Cable Will Move 1 Petabit per Second Across the Atlantic](https://alphasignal.ai/news/meta-s-petal-cable-will-move-1-petabit-per-second-across-the-atlantic.md) (2026-09-21)
- [Cognition's Devin Cloud Lets Developers SSH Into AI Coding Sessions](https://alphasignal.ai/news/cognition-s-devin-cloud-lets-developers-ssh-into-ai-coding-sessions.md) (2026-09-21)
- [SGLang Squeezes 78% More AI Throughput on NVIDIA's Blackwell GPUs](https://alphasignal.ai/news/sglang-squeezes-78-more-ai-throughput-on-nvidia-s-blackwell-gpus.md) (2026-09-21)
- [MiniMax H3 Runs Locally Across Four RTX 3090s, Cutting Video Time by 2.84x](https://alphasignal.ai/news/minimax-h3-runs-locally-across-four-rtx-3090s-cutting-video-time-by-2-84x.md) (2026-09-21)
- [HyperQwen Runs Qwen3.8-27B on a Single RTX 3090 at 1,035 tok/s](https://alphasignal.ai/news/hyperqwen-runs-qwen3-8-27b-on-a-single-rtx-3090-at-1-035-tok-s.md) (2026-09-19)
- [Tamara Tran's fast-jev-compaction Stops Claude Code From Forgetting Critical Tool Output](https://alphasignal.ai/news/tamara-tran-s-fast-jev-compaction-stops-claude-code-from-forgetting-critical.md) (2026-09-18)
- [Perplexity Computer Adds Four Effort Presets to Control AI Task Depth](https://alphasignal.ai/news/perplexity-computer-adds-four-effort-presets-to-control-ai-task-depth.md) (2026-09-17)
- [vLLM Boosts Kimi K3 Throughput by 2.8× With Smarter Scheduling](https://alphasignal.ai/news/vllm-boosts-kimi-k3-throughput-by-2-8-with-smarter-scheduling.md) (2026-09-17)
- [Jarrod Watts Ships Jev Trader to Make AI-Guided Crypto Trades in 100ms](https://alphasignal.ai/news/jarrod-watts-ships-jev-trader-to-make-ai-guided-crypto-trades-in-100ms.md) (2026-09-17)
- [Bojie Li's Open Textbook Teaches AI Infrastructure Through Hardware Limits](https://alphasignal.ai/news/bojie-li-s-open-textbook-teaches-ai-infrastructure-through-hardware-limits.md) (2026-09-16)
- [Mia AI Lab Runs GLM-5.3-Flash Across Two DGX Sparks at 146 tok/s](https://alphasignal.ai/news/mia-ai-lab-runs-glm-5-3-flash-across-two-dgx-sparks-at-146-tok-s.md) (2026-09-15)
- [Perplexity's CobbleDB Cuts Search Storage Latency by 82% Over DynamoDB](https://alphasignal.ai/news/perplexity-s-cobbledb-cuts-search-storage-latency-by-82-over-dynamodb.md) (2026-09-15)
- [Unity's FlashVector Uses AI to Double Recommender System Serving Speed](https://alphasignal.ai/news/unity-s-flashvector-uses-ai-to-double-recommender-system-serving-speed.md) (2026-09-15)
- [Edge0 Runs a 35B AI Model on a Mac mini Using SSD](https://alphasignal.ai/news/edge0-runs-a-35b-ai-model-on-a-mac-mini-using-ssd.md) (2026-09-10)
- [Intelligent Internet's Meta-Zenith Agent Rewrote vLLM Kernels for a 4x Speedup](https://alphasignal.ai/news/intelligent-internet-s-meta-zenith-agent-rewrote-vllm-kernels-for-a-4x-speedup.md) (2026-09-09)
- [Cohere's Open-Source Megakernel Beats vLLM by 1.58x on H100](https://alphasignal.ai/news/cohere-s-open-source-megakernel-beats-vllm-by-1-58x-on-h100.md) (2026-09-08)
- [vLLM's Hybrid HiSparse Triples Concurrent Requests on Million-Token Contexts](https://alphasignal.ai/news/vllm-s-hybrid-hisparse-triples-concurrent-requests-on-million-token-contexts.md) (2026-09-08)
- [Experiential Gives AI Agents One Open-Source Gateway to Rule All Models](https://alphasignal.ai/news/experiential-gives-ai-agents-one-open-source-gateway-to-rule-all-models.md) (2026-09-05)
- [Perplexity's ROSE Serving Stack Beats vLLM on Speed and Latency](https://alphasignal.ai/news/perplexity-s-rose-serving-stack-beats-vllm-on-speed-and-latency.md) (2026-09-04)
- [Nous Research's Hermes Desktop Picks and Runs Local AI Models in One Click](https://alphasignal.ai/news/nous-research-s-hermes-desktop-picks-and-runs-local-ai-models-in-one-click.md) (2026-09-03)
- [Cursor Lets Enterprise Teams Run AI Coding Agents on Their own Servers](https://alphasignal.ai/news/cursor-lets-enterprise-teams-run-ai-coding-agents-on-their-own-servers.md) (2026-09-02)
- [Perplexity's Lily Beats MLX-LM by 1.35x Running Qwen3.6 on Apple Silicon](https://alphasignal.ai/news/perplexity-s-lily-beats-mlx-lm-by-1-35x-running-qwen3-6-on-apple-silicon.md) (2026-09-02)
- [Moonshot AI's Kimi Code Now Lets You Control Coding Sessions From Any Device](https://alphasignal.ai/news/moonshot-ai-s-kimi-code-now-lets-you-control-coding-sessions-from-any-device.md) (2026-08-28)
- [Qwen3.8-27B Hits 417 tok/s on a Single RTX 3090 With 150k Context](https://alphasignal.ai/news/qwen3-8-27b-hits-417-tok-s-on-a-single-rtx-3090-with-150k-context.md) (2026-08-27)
- [Red Hat Shrinks GLM-5.3-Flash to 4-Bit for NVIDIA Blackwell GPUs](https://alphasignal.ai/news/red-hat-shrinks-glm-5-3-flash-to-4-bit-for-nvidia-blackwell-gpus.md) (2026-08-27)
- [vLLM v0.28.0 Ships Sparse Attention and 60% Faster Speculative Decoding](https://alphasignal.ai/news/vllm-v0-28-0-ships-sparse-attention-and-60-faster-speculative-decoding.md) (2026-08-27)
- [NVIDIA's Dynamo Cuts LLM Engine Crash Recovery from 283 Seconds to 7](https://alphasignal.ai/news/nvidia-s-dynamo-cuts-llm-engine-crash-recovery-from-283-seconds-to-7.md) (2026-08-25)
- [Exo Turns Four Mac Studios Into a 4.8TB/s AI Cluster](https://alphasignal.ai/news/exo-turns-four-mac-studios-into-a-4-8tb-s-ai-cluster.md) (2026-08-25)
- [OpenAI's Jalapeño Chip Beats Nvidia's Best on Inference by 3.6x](https://alphasignal.ai/news/openai-s-jalapeno-chip-beats-nvidia-s-best-on-inference-by-3-6x.md) (2026-08-25)
- [Perplexity's Portable Computer Moves AI Agents off the Cloud and onto Your Desk](https://alphasignal.ai/news/perplexity-s-portable-computer-moves-ai-agents-off-the-cloud-and-onto-your-desk.md) (2026-08-25)
- [Mia AI Lab's DFlash2 Drafter Boosts Qwen3.8 Decoding Speed by 33%](https://alphasignal.ai/news/mia-ai-lab-s-dflash2-drafter-boosts-qwen3-8-decoding-speed-by-33.md) (2026-08-24)
- [OpenAI Gives Developers Hard Spend Limits to Stop Runaway API Bills](https://alphasignal.ai/news/openai-gives-developers-hard-spend-limits-to-stop-runaway-api-bills.md) (2026-08-21)