[P] What are the latest "out of the box solutions" for deploying the very large LLMs as API endpoints? Submitted by johnhopiler t3_11a8tru on February 23, 2023 at 9:09 PM in MachineLearning 11 comments 10
muwnd t1_j9qv9qx wrote on February 23, 2023 at 10:30 PM https://github.com/huggingface/text-generation-inference Permalink 5
Viewing a single comment thread. View all comments