Google brings vLLM and SGLang to TPUs in PyTorch, with Meta already running it
Google launched PyTorch-native vLLM and SGLang engines for its TPUs, built with Inferact and RadixArk. SGLang already serves…
AI news from the companies shaping it: OpenAI, Google, Anthropic, Meta, Nvidia, Microsoft, Apple and more. Launches, deals, chips and strategy.
Page 8 of 32
Google launched PyTorch-native vLLM and SGLang engines for its TPUs, built with Inferact and RadixArk. SGLang already serves…
ElevenLabs' new Eleven Realtime models replace the speech recognition, LLM and text-to-speech chain with one model, and can…
DeepSeek has published DeepInfer, the inference framework it says powers its production services, under Apache 2.0. The release…
Apple adds Perryman Company for iPhone Duo titanium, widens Qnity's camera role on iPhone 18 Pro, and lists…
IBM Research says llm-d 1.0, the Kubernetes-native inference project backed by Red Hat and Google, now has the…
Amazon says it will invest more than €16 billion in Germany next year, across AWS data centers, its…
Google Cloud has put Gemini for government services into preview, with skills for FOIA discovery, redaction and bid…
Gemini edits photos from plain-language prompts: upload a picture, say what to change and what to keep, and…
Security researchers at redact.dev say WhatsApp help pages carried invisible text telling an AI not to recommend data…
Microsoft no longer sells Copilot Pro; its paid features now sit in Microsoft 365 Premium, while the Copilot…
Wired reports that Character.AI's bankruptcy is part of a Disney deal for its people and technology, while the…
Jim Keller's chip company closed a Series E led by Trace Capital and Innovation X, and says the…