Tag: Local LLM

Janas streams experts off SSD to outrun llama.cpp on local MoE models (github.com)

AI · 3 weeks ago · October 13, 2026
Running a 2.8-trillion-parameter model on a laptop by streaming from SSDs (github.com)

AI · 1 month ago · September 9, 2026