← Back to feed

SDCGuard – Inspect vLLM KV-checksum coverage per request

AI · Technology · 2026-11-02 17:47

SDCGuard是一个开源工具，用于逐请求检查vLLM推理中KV缓存的校验和覆盖情况，帮助定位静默数据损坏并评估推理可靠性。

Source: github.com

Auto-generated summary for reference only. RSS