Submitted by hx-zero t3_zl03b0 in MachineLearning
hx-zero OP t1_j05i3j5 wrote
Reply to comment by ReginaldIII in [Project] Run and fine-tune BLOOM-176B at home using a peer-to-peer network by hx-zero
A Petals client does not allow others to use your GPU by default, you need to explicitly run a Petals server (a separate program) for this.
In the Colab example, we only run the client, so its GPU can't be used by anyone besides the user directly running the notebook.
ReginaldIII t1_j06l171 wrote
Sorry this is what I meant. I assumed OP was asking about running workers on colab.
Running the client would of course be no different than running anything that needs to draw in assets from the network.
Viewing a single comment thread. View all comments