Humble beginnings, but encouraging enough to deploy on the network. EXO is an open-source framework which allows users to run AI models on a distributed cluster of heterogeneous devices running various operating systems. EXO splits up large AI models into smaller shards and distributes them across multiple networked devices, unifying existing infrastructure one powerful virtual GPU. While not fully featured yet, it is potentially suitable for deploying large models across multiple devices.
