Submitted by AylaDoesntLikeYou t3_11c5n1g in singularity
Akashictruth t1_ja3awb4 wrote
Reply to comment by Ok-Ability-OP in Meta unveils a new large language model that can run on a single GPU by AylaDoesntLikeYou
They mean a top of the line gpu priced in the thoudands like RTX 4090 and its probably slow as hell, barely consumer-grade
rixtil41 t1_ja4pgmr wrote
It has to start somewhere
katiecharm t1_ja605k0 wrote
The idea that ChatGPT can run slowly on a 4090 is shockingly amazing still.
Viewing a single comment thread. View all comments