AI ยท 2026-10-22 17:25
vLLM has released vllm-torchtpu, a new backend for Google Cloud TPUs built on the TorchTPU stack. It runs existing vLLM model definitions directly and supports KV cache offloading and disaggregated serving.
Auto-generated summary for reference only. RSS