← Back to feed

WavePP: High-Throughput Pipeline Parallel LLM Prefill Under Prefix Reuse

AI · Research · 2026-11-20 09:02

WavePP introduces a pipeline parallelism approach to optimize the prefill phase of large language models under prefix reuse scenarios, significantly improving system throughput.

Source: arxiv.org


Auto-generated summary for reference only. RSS