Apple demos running 816B large model locally on Mac Studio cluster with MLX and RDMA
Original title:Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
AI summary
Apple's machine learning research team demonstrated how to run frontier models with nearly a trillion parameters, such as Muse Spark Open, locally on Mac Studio, using the new MLX (from v0.30.1) released today and the RDMA over Thunderbolt driver in macOS 26.2.
Key Takeaways
- Apple's machine learning research team demonstrated how to run frontier models with nearly a…
- such as Muse Spark Open,locally on Mac Studio,using the new MLX (from v0.
- 1) released today and the RDMA over Thunderbolt driver in macOS 26.
Quick Facts
- Published
- Updated
- Category
- Tutorials & Tips
- AI score
- 60
Apple 给出了在 Mac Studio 集群上跑 816B MoE 模型的并行方案与基准数据,可迁移到本地大模型部署实践。
Related entities
Source & copyright
This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.
How to Cite
When citing this article, keep the title, date, and permalink, and credit Orange News as the source.
Orange News: Apple demos running 816B large model locally on Mac Studio cluster with MLX and RDMA. October 15, 2026. https://new.nat6.net/en/news/j76j898zc7y8on4s10d4nvpan/