[D] Most efficient open source language model ? Submitted by Meddhouib10 t3_ybx4nt on October 24, 2022 at 12:15 AM in MachineLearning 11 comments 7
axamar463 t1_itk6p6d wrote on October 24, 2022 at 6:42 AM You should look into deepsparse, they are working on delivering GPU level performance on consumer CPUs with some great results: https://github.com/neuralmagic/deepsparse. There is a great interview with the founder, Nir Shavit here: https://piped.kavin.rocks/watch?v=0PAiQ1jTN5k Permalink 6
Viewing a single comment thread. View all comments