CUDA+ROCm dual-back ends LLM inference for mixed-vendor GPUs (up to 48% faster)
AI · Hardware · 2026-11-10 02:05
A new GitHub project enables LLM inference on mixed-vendor GPUs by supporting both CUDA and ROCm backends, claiming up to 48% performance improvements.