DeVault: Reforming the free software message

Posted Jun 23, 2023 13:41 UTC (Fri) by pabs (subscriber, #43278)
In reply to: DeVault: Reforming the free software message by kleptog
Parent article: DeVault: Reforming the free software message

There actually are groups doing their own training from scratch, including crowdsourced data for training. I don't recall their names, but the Hacker News search would be the place to find them.

DeVault: Reforming the free software message

Posted Jun 23, 2023 17:41 UTC (Fri) by Cyberax (✭ supporter ✭, #52523) [Link]

Really large models are still out of range for hobbyist training. Instead, people found ways to optimize models, so they don't need as much training time.

Also, training is not embarrassingly parallel like SETI or Folding-At-Home, so it's not possible (at least not right now) to just crowdsource the computation cycles.