[D] Running large language models on a home PC? Submitted by Zondartul t3_zrbfcr on December 21, 2022 at 5:29 AM in MachineLearning 41 comments 86
head_robotics t1_j14e1fn wrote on December 21, 2022 at 4:15 PM Another question could be what is the minimal sized language model that could be useful? If the largest models can't be reasonably run, what about smaller models that could be? Any chance of getting usable results for reasonable speed? Permalink 3
Viewing a single comment thread. View all comments