Viewing a single comment thread. View all comments

Desticheq t1_j9qo0mu wrote

Hugginface actually allows a fairly easy deployment process for models trained with their framework

8

theLastNenUser t1_j9uwhcd wrote

You will have to message them if you want to use the larger GPU boxes, and the autoscaling isn’t great for larger models. The customizability of the “handler.py” file is nice though

2

Desticheq t1_j9xiv9l wrote

Well, in terms of "out-of-the-box," I'm not sure what else could be better. AWS, Azure or Google provide empty units basically, and you'd have to configure all the "Ops" stuff like network, security, load balancing, etc. That's not that difficult if you do it once in a while, but for a "test-it-and-forget-it" project it might be too difficult.

2