AI · Hardware · 2026-11-12 17:43
WiCi has introduced InferSSD, an open-source inference engine that claims to enable local execution of 800-billion-parameter large language models on consumer-grade hardware such as Macs and PCs.
Auto-generated summary for reference only. RSS