[JP] AppleがMLX分散推論をアップデート！Mac Studio 4台で約1兆パラメータモデル「Muse Spark Open」が爆速動作
[EN] Apple Updates MLX Distributed Inference! Mac Studio Cluster Runs Massive 1 Tri…

https://ai-minor.com/blog/en/2026-10-16-1792135244518-local_and_distributed_large_llm_inference_with_mlx

#MLX #MacStudio #ローカルLLM #AI #Tech

Mac StudioにおけるMLXとRDMAを活用した大規模LLMローカル分散推論の探求

MLXとRDMAによる大規模LLM分散推論

#MLX #LLM推論 #AppleSilicon #RDMA #分散コンピューティング

The update includes updating llama.cpp for decision models and optimizing recurrent state in MLX.

#Ollama #LlamaCPP #MLX

The second tutorial in the MLX series focuses on setting up an MLX server on a Mac and running an LLM locally👇🏼

theaiops.substack.com/p/getting-st...

#llm #ai #mlx

Generating AI videos locally. A Mac with 64 GB runs Wan 2.2 without the cloud, with the MLX setup step by step.
Read the full article
www.rotecodefraktion.de/en/blog/loka...

#LocalAI #AppleSilicon #MLX #opensource

Uzu fast #inference engine 4 #macOS & #iOS. Native #Rust. Bindings: #Python, #TypeScript, #Swift or #CLI. ~ x4 faster vs. llama.cpp & #MLX with #Qwen 3.5 9B Q4, on #M5 #MacBook Pro:
- Uzu 92 tokens/s
- llama.cpp 22 t/s
- MLX 25 t/s
Needs lalamo model format converter

#AI #LLM
#OpenSource MIT Lic

I hope a nice, quantitized version of this shows up so I can try it with #MLX #oMLX.

#AI #LocalModels #DataSovereignty https://flipboard.com/@cnet/tech-tips-%F0%9F%93%B1%F0%9F%92%BB%F0%9F%93%A1-a20abmejz/-/a-R7H13fpdRD2YWFm63mDbgg%3Aa%3A24934323-%2F0

I started a new sequence of tutorials, this time focusing on running LLMs locally on Mac with MLX LM.

MLX LM is Apple’s framework for running LLMs locally on Apple Silicon, based on MLX - an array framework designed for machine learning on Apple Silicon 👇🏼

#ai #llm #mlx

Just the decision your software actually needs.

One important detail: this is an independent MLX port, not an official Convai Innovations release.

🔗 github.com/mizorewww/l...

#AI #AppleSilicon #MLX #LLM #MachineLearning #LocalAI #OpenSource #Python #AIAgents #Developers

#localai #ai #mlx #applesilicon
Amazing milestone for oMLX. The founder just joined Hugging Face, now focusing full time on the project.

omlx.ai

Jun Kim moves from side project maintainer to full-time Hugging Face staff on oMLX. Focus: faster transformers-to-MLX model conversion and stronger collaboration across local AI ecosystem. #MLX #HuggingFace

https://bymachine.news/jun-kim-hugging-face-mlx-staff

oMLX開発者Jun Kim氏、Hugging Faceに参画 — MLXエコシステムの更なる進化へ

oMLX開発者がHugging Faceに参画。MLXコミュニティ支援強化。

#MLX #HuggingFace #AppleSilicon #オープンソースAI #機械学習フレームワーク

Just started playing around with the #pi.dev agent harness. Trying to elevate my agentic workflows. Cool stuff.

Any recommended #pi setups? I initially experimented with #ollama, but just learned about #mlx-lm which is designed to run far better on Apple silicon. Going to give it a shot.

Ollama steigert mit MLX die Leistung auf Apple Silicon deutlich: schneller, besser, speicherschonender. Lokale KI wird zur echten Alternative. #MLX

Mehr von mir: linkedin.com/in/maurice-putinas