Viewing a single comment thread. View all comments

HeyLittleTrain t1_j77w36w wrote on February 4, 2023 at 7:23 PM

Reply to comment by Lengador in [R] Multimodal Chain-of-Thought Reasoning in Language Models - Amazon Web Services Zhuosheng Zhang et al - Outperforms GPT-3.5 by 16% (75%->91%) and surpasses human performance on ScienceQA while having less than 1B params! by Singularian2501

At what size could I run a model on a decent gaming PC?

emotionalfool123 t1_j78bjj2 wrote on February 4, 2023 at 9:13 PM

Stable diffusion is around 866M params which can be run on 12gb 3080

7734128 t1_j9j9r06 wrote on February 22, 2023 at 11:03 AM

And on my 8 GB GTX 1080.

Lengador t1_j78ovy2 wrote on February 4, 2023 at 10:51 PM

You can (just) run a 1B parameter model on a good gaming rig.

i2mi t1_j786bu0 wrote on February 4, 2023 at 8:35 PM

Around 2M Edit: the number I gave is completely delusional. Sorry

HeyLittleTrain t1_j7avkil wrote on February 5, 2023 at 12:32 PM

Your answer seems substantially different than the others.

NapkinsOnMyAnkle t1_j9jtolb wrote on February 22, 2023 at 2:12 PM

I've trained 100m CNNs on my laptop 3070 6gb. So...