visarga OP t1_jegmcux wrote on March 31, 2023 at 9:36 PM

Reply to comment by mjk1093 in HuggingGPT - Solving AI Tasks with ChatGPT and its Friends in HuggingFace by visarga

I think they spin up a container if there isn't one running. Usually there isn't, so you have to wait a minute or two. Then it works slowly, but it is simpler than downloading the model.

In this paper the HuggingGPT system uses a bunch of local models, and calls on the HuggingFace API for the rest. So they try to run their own tool-models, at least a few of them because HF is so flaky.

I think this paper is pretty significant. It expands the OpenAI Plugin concept with AI-plugins. This is great because you can have a bunch of specialised models combined in countless ways, chatGPT being the orchestrator. It's automated AI pipelines. If nothing else, it could be used to generate training data for a multi-modal model like GPT-4. Could be a good business opportunity for HuggingFace too, their model zoo is impressive.

mjk1093 t1_jegn93v wrote on March 31, 2023 at 9:42 PM

I have found that the spaces tend to get slower the more you use them. It feels like throttling.

RobLocksta t1_jeh1mtc wrote on March 31, 2023 at 11:29 PM

Great post! I've been looking for something like this that would allow me to look at models tuned towards my industry. Sounds like a great place to learn!