whata_wonderful_day t1_ja3kh4d wrote
Reply to comment by CKtalon in [P] What are the latest "out of the box solutions" for deploying the very large LLMs as API endpoints? by johnhopiler
Yeah this is what the big bois use. It'll give you max performance, but isn't exactly user friendly
Viewing a single comment thread. View all comments