MLX Studio: a macOS app to download, run and serve MLX models on Apple Silicon
problem
To run a local model on a Mac you usually need three command-line tools: one to download the weights, one to serve them and one to chat. You find out that a model does not fit in memory at a given context length only when loading fails. Connecting your own code to the model is one more integration.