← Back to feed

FastAPI-stream-lease – Limit concurrent SSE/LLM streams instead of req/min

IT · 2026-10-20 14:48

开源项目fastapi-stream-lease提出以限制并发SSE/LLM流数量替代传统的每分钟请求数限流，更适合流式AI接口的资源控制。

Source: github.com

Auto-generated summary for reference only. RSS