Exo

Distributes a model across several machines so hardware that could not run it alone can run it together. It is the multi-machine counterpart to Ollama above.

I have used Exo to connect multiple devices into a distributed local AI cluster and explore models across their combined hardware.

Experience highlights

• Combine compatible devices into an automatically discovered AI cluster.
• Experiment with running models that benefit from resources distributed across more than one device.