
4 days
it uses a lot less energy since it runs on your home or company’s infrastructure.
A CPU-cycle requires energy no matter where it is. The open source models may be more efficient, or you may distribute the power usage over a greater geographical area. But you’re not using less energy because you’re running the model at home.
Because of that, I predict that we’re going to see a lot of financial hardship among AI companies.
I do like the idea that open source will kill tech giants.
Some Oracle hr droid tried to hire me fresh out of university. It’s been “some” years, and I’ve never heard anybody saying that I was a fool for turning it down.