a]:hidden"> Jun Kim, oMLX creator and maintainer, joins Hugging Face to support the MLX community
We are super excited to welcome Jun as our newest team member 🔥. We are completely invested in local AI, and MLX is a central piece of the ecosystem. We are delighted that Jun chose us to set up home and continue contributing to MLX.
MLX is Apple's framework for local AI, especially optimized for Apple Silicon. We are big MLX supporters since it was the Christmas present from Awni and Angelos in 2023, and proud that Hugging Face is the Hub where people find MLX models and contribute their own. Usage of open, local AI is accelerating, and we believe in a healthy ecosystem where people can find the tools that work for them.
What is the impact for oMLX?
Stability, and hopefully faster development! Graduating from a side job to a fully maintained and funded project will allow Jun to better guide the contributors and build for the long-term. oMLX stays Apache 2.0, and Jun keeps leading it as before.
What is the impact for MLX at large?
Our end goal is to unblock the community to run local AI in any shape or form, and provide the tools and building blocks to make that happen. We expect oMLX to serve as a testbed for new ideas, while leveraging the foundational work of the dependencies it already relies upon, such as mlx-lm or mlx-vlm . We believe that strong modeling and inference libraries help the community, so we'd love to upstream work to wherever it makes sense. We have been collaborating with many projects mlx-lm, mlx-vlm, LMStudio, and we hope we can strengthen the relationship with Cheng , Prince , Yagil , and their teams to better serve the community together.
Concretely, one focus area is the quick transition from a transformers model definition to a reference MLX implementation that can be consumed by different engines, so each one can focus on the unique features they provide. The transformers library has become the reference for ML model definitions, we want to streamline the process to make new transformers models run on MLX.
We are incredibly excited about the future.
The PR you would have opened yourself
Introducing AnyLanguageModel: One API for Local and Remote LLMs on Apple Platforms
Community
The omlx GitHub repository seems deleted. Any new url ?
Yep, seeing this too. Just needed a dmg for a friend, but no luck today.
Kudos!!! Excited for this chapter for ya.
Welcome! Was totally expected and well deserved
Jundot replied to me that he likely got autobanned shortly after posting this exact information in the repository Discussions - likely an overzealous github/microslop moderation bot. Let's hope he gets it back soon. I managed to sync my repo with the github fork-network right after it got banned, so you can grab the newest code at zviratko/omlx temporarily until it gets resolved.
How would it impact supporting other MLX inference engines and tools like mlx-optiq?