← Back to feed

Janas: Run LLMs larger than RAM by streaming experts from SSD

AI · Technology · 2026-10-12 22:05

Janas streams expert modules from SSD, enabling LLMs larger than available memory to run efficiently on laptops with performance exceeding llama.cpp.

Source: github.com

Auto-generated summary for reference only. RSS