Exo Labs runs powerful open-source AI models in local compute clusters with the help of the Apple M4 chip, a solution that reduces costs, improves privacy security, and eliminates the need to rely on cloud services. In addition, they plan to launch a benchmarking website in order to help users pick the right hardware configuration for AI tasks.
Open source address:
https://github.com/exo-explore/exo