Uzu fast #inference engine 4 #macOS & #iOS. Native #Rust. Bindings: #Python, #TypeScript, #Swift or #CLI. ~ x4 faster vs. llama.cpp & #MLX with #Qwen 3.5 9B Q4, on #M5 #MacBook Pro:
- Uzu 92 tokens/s
- llama.cpp 22 t/s
- MLX 25 t/s
Needs lalamo model format converter

#AI #LLM
#OpenSource MIT Lic

I hope a nice, quantitized version of this shows up so I can try it with #MLX #oMLX.

#AI #LocalModels #DataSovereignty https://flipboard.com/@cnet/tech-tips-%F0%9F%93%B1%F0%9F%92%BB%F0%9F%93%A1-a20abmejz/-/a-R7H13fpdRD2YWFm63mDbgg%3Aa%3A24934323-%2F0

I started a new sequence of tutorials, this time focusing on running LLMs locally on Mac with MLX LM.

MLX LM is Apple’s framework for running LLMs locally on Apple Silicon, based on MLX - an array framework designed for machine learning on Apple Silicon 👇🏼

#ai #llm #mlx

Just the decision your software actually needs.

One important detail: this is an independent MLX port, not an official Convai Innovations release.

🔗 github.com/mizorewww/l...

#AI #AppleSilicon #MLX #LLM #MachineLearning #LocalAI #OpenSource #Python #AIAgents #Developers

#localai #ai #mlx #applesilicon
Amazing milestone for oMLX. The founder just joined Hugging Face, now focusing full time on the project.

omlx.ai

Jun Kim moves from side project maintainer to full-time Hugging Face staff on oMLX. Focus: faster transformers-to-MLX model conversion and stronger collaboration across local AI ecosystem. #MLX #HuggingFace

https://bymachine.news/jun-kim-hugging-face-mlx-staff

oMLX開発者Jun Kim氏、Hugging Faceに参画 — MLXエコシステムの更なる進化へ

oMLX開発者がHugging Faceに参画。MLXコミュニティ支援強化。

#MLX #HuggingFace #AppleSilicon #オープンソースAI #機械学習フレームワーク

Just started playing around with the #pi.dev agent harness. Trying to elevate my agentic workflows. Cool stuff.

Any recommended #pi setups? I initially experimented with #ollama, but just learned about #mlx-lm which is designed to run far better on Apple silicon. Going to give it a shot.

Ollama steigert mit MLX die Leistung auf Apple Silicon deutlich: schneller, besser, speicherschonender. Lokale KI wird zur echten Alternative. #MLX

Mehr von mir: linkedin.com/in/maurice-putinas