@gajesh: Darkbloom turns idle Macs into a private inference network

Darkbloom is a project that aims to connect idle Macs directly to inference demand, bypassing what its authors call the Inference Tax, the margin layers that they say sit between AI API calls and the hardware. The post says there are over 100 million Macs with Apple Silicon, that a $3k Mac can run a 60B model at 30 watts, and that most sit idle most of the day. The project describes itself as a private inference network for idle Macs, with its paper and code open at darkbloom.dev and invites for free credits offered in replies.