[P] What are the latest "out of the box solutions" for deploying the very large LLMs as API endpoints? Submitted by johnhopiler t3_11a8tru on February 23, 2023 at 9:09 PM in MachineLearning 11 comments 10
johnhopiler OP t1_j9u0kpb wrote on February 24, 2023 at 3:38 PM There are also https://alpa.ai/tutorials/opt_serving.html and https://colossalai.org/docs/advanced_tutorials/opt_service/ Permalink 1
Viewing a single comment thread. View all comments