Project Maya runs 300B MoE models locally
Project Maya is a local inference engine for massive Mixture-of-Experts models such as GLM‑5.3‑Flash and DeepSeek‑V4.1. It offloads inactive experts to system RAM and NVMe SSDs, enabling 748B‑parameter models to run on single or multi‑GPU setups. The API follows OpenAI and Anthropic standards, supporting tool calls and concurrent requests. It is worth trying if you have high‑end local hardware and need private, low‑latency LLM access without cloud costs. However, the hardware floor is steep – you’ll need 100GB+ combined VRAM and RAM for usable performance. It is not suitable for standard consumer laptops or low‑memory systems. sumber: github.com/mw00/project-maya my other side: setyadi.com
