Submitted by hx-zero t3_zl03b0 in MachineLearning
londons_explorer t1_j0642cz wrote
Reply to comment by ReginaldIII in [Project] Run and fine-tune BLOOM-176B at home using a peer-to-peer network by hx-zero
I suspect there will be far more accidentally malicious clients (because someone is experimenting with the code) than deliberately evil clients.
In fact, as long as the percentage of deliberately evil clients is small, and the weight updates they send have capped magnitudes, I suspect you can just ignore the problem - they won't have a substantial effect on the results.
Viewing a single comment thread. View all comments