AI · Technology · 2026-10-17 18:10
The model runs on the iPhone 18 Neural Engine at 1.5 bits per weight quantization, achieving inference speeds of 15 to 70 tokens per second, demonstrating the performance potential of on-device large models.
Auto-generated summary for reference only. RSS