Tutorials & Tips

Apple demos running 816B large model locally on Mac Studio cluster with MLX and RDMA

Original title:Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

AI summary

Apple's machine learning research team demonstrated how to run frontier models with nearly a trillion parameters, such as Muse Spark Open, locally on Mac Studio, using the new MLX (from v0.30.1) released today and the RDMA over Thunderbolt driver in macOS 26.2.

Key Takeaways

  • Apple's machine learning research team demonstrated how to run frontier models with nearly a…
  • such as Muse Spark Open,locally on Mac Studio,using the new MLX (from v0.
  • 1) released today and the RDMA over Thunderbolt driver in macOS 26.

Quick Facts

Published
Updated
Source
Apple Machine Learning Research(RSS)
Category
Tutorials & Tips
Topic
Deployment EngineeringTutorials & Practice
AI score
60
Read the original Read the full article at the original source
Why it matters

Apple 给出了在 Mac Studio 集群上跑 816B MoE 模型的并行方案与基准数据,可迁移到本地大模型部署实践。

Topics

Related entities

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: Apple demos running 816B large model locally on Mac Studio cluster with MLX and RDMA. October 15, 2026. https://new.nat6.net/en/news/j76j898zc7y8on4s10d4nvpan/

View all →