[D] Running large language models on a home PC? Submitted by Zondartul t3_zrbfcr on December 21, 2022 at 5:29 AM in MachineLearning 41 comments 86
visarga t1_j14bnb7 wrote on December 21, 2022 at 3:59 PM Reply to comment by CKtalon in [D] Running large language models on a home PC? by Zondartul GLM-130B runs on 4x 3090, uses INT4. Permalink Parent 6
Viewing a single comment thread. View all comments