AI · Technology · 2026-10-26 12:59
Testing vLLM 0.28 serving Kimi K2.6, the author found tool-call schema compliance at only 92%, and explains how constrained decoding can guarantee structural compliance. The feature has now been released.
Auto-generated summary for reference only. RSS