mjk1093 t1_jegl6ux wrote on March 31, 2023 at 9:28 PM

Reply to comment by visarga in HuggingGPT - Solving AI Tasks with ChatGPT and its Friends in HuggingFace by visarga

Unlike GitHub, most of the "spaces" on HuggingFace seem to be broken, unresponsive, or incredibly slow. Maybe that's just been my experience, and I don't know where to look for the good ones.

visarga OP t1_jegmcux wrote on March 31, 2023 at 9:36 PM

I think they spin up a container if there isn't one running. Usually there isn't, so you have to wait a minute or two. Then it works slowly, but it is simpler than downloading the model.

In this paper the HuggingGPT system uses a bunch of local models, and calls on the HuggingFace API for the rest. So they try to run their own tool-models, at least a few of them because HF is so flaky.

I think this paper is pretty significant. It expands the OpenAI Plugin concept with AI-plugins. This is great because you can have a bunch of specialised models combined in countless ways, chatGPT being the orchestrator. It's automated AI pipelines. If nothing else, it could be used to generate training data for a multi-modal model like GPT-4. Could be a good business opportunity for HuggingFace too, their model zoo is impressive.

mjk1093 t1_jegn93v wrote on March 31, 2023 at 9:42 PM

I have found that the spaces tend to get slower the more you use them. It feels like throttling.

RobLocksta t1_jeh1mtc wrote on March 31, 2023 at 11:29 PM

Great post! I've been looking for something like this that would allow me to look at models tuned towards my industry. Sounds like a great place to learn!