luaks1337 t1_jc24dqa wrote
Reply to comment by remghoost7 in [P] Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM by Amazing_Painter_7692
They managed to run the 7B model on a Raspberry PI and a Samsung Galaxy S22 Ultra.
thoughtdrops t1_jcjjq48 wrote
>Samsung Galaxy S22 Ultra.
can you link to the samsung galaxy post? that sounds great
Viewing a single comment thread. View all comments