github.com · Inference Engines
Rare Pick
MLX

About

MLX is an open-source machine learning framework designed for Apple silicon, providing a NumPy-like API in Python and a C++ API. It enables researchers and developers to efficiently train and deploy machine learning models on Apple hardware, leveraging the unified memory architecture for optimized performance.

This framework is suitable for machine learning practitioners, researchers, and developers who work with Apple devices and require a high-performance, flexible tool for model development, experimentation, and inference. It supports a variety of machine learning tasks, from research prototyping to deployment.

Used by 1 person

More in Inference Engines

See all
Rare Pickgithub.com
SGLang

SGLang

Rare Pickgithub.com
ExLlamaV3

ExLlamaV3

Rare Pickgithub.com
vLLM

vLLM

Rare Pickgithub.com
llama.cpp

llama.cpp