← Back to feed

Gandalf: Extending SSD Lifespan for LLM KV Cache Offloading

AI · Research · 2026-10-31 15:32

The paper introduces Gandalf, a method for offloading LLM KV cache to flash storage during serving while accounting for write endurance, mitigating SSD wear. The abstract page provides only author and submission details.

Source: arxiv.org


Auto-generated summary for reference only. RSS