futilehabit t1_jc10obb wrote on March 13, 2023 at 6:45 AM Reply to comment by cr125rider in [P] Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM by Amazing_Painter_7692 Guess hospice is pretty boring Permalink Parent 2
futilehabit t1_jc10obb wrote
Reply to comment by cr125rider in [P] Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM by Amazing_Painter_7692
Guess hospice is pretty boring