spriggankin t1_jeg8vm4 wrote on March 31, 2023 at 8:05 PM

I thought this was a companion sort of AI based on the name..

visarga OP t1_jega0z1 wrote on March 31, 2023 at 8:12 PM

No, it's a serious paper. They can orchestrate hundreds of models from HuggingFace through chatGPT. That's like AI plugins for AI chat.

spriggankin t1_jegaydf wrote on March 31, 2023 at 8:18 PM

I just never heard of huggingface before I guess. Sounds interesting though, going to look into it

visarga OP t1_jegd2cs wrote on March 31, 2023 at 8:33 PM

HuggingFace is the GitHub of AI. It hosts 166,392 AI models and 26,787 datasets. It has implementations for all the models in its own framework and is usually the starting codebase for research papers. You can also interact with many models right on their website in the "spaces" section.

You can also see it like an App Store for AI, you can shop for models and then include them in your project with 5 lines of code.

spriggankin t1_jegdrzn wrote on March 31, 2023 at 8:37 PM

Seeing as how chatgpt is now banned where Im from as of a few hours ago, I need to find an alternative : /

mjk1093 t1_jegl6ux wrote on March 31, 2023 at 9:28 PM

Unlike GitHub, most of the "spaces" on HuggingFace seem to be broken, unresponsive, or incredibly slow. Maybe that's just been my experience, and I don't know where to look for the good ones.

visarga OP t1_jegmcux wrote on March 31, 2023 at 9:36 PM

I think they spin up a container if there isn't one running. Usually there isn't, so you have to wait a minute or two. Then it works slowly, but it is simpler than downloading the model.

In this paper the HuggingGPT system uses a bunch of local models, and calls on the HuggingFace API for the rest. So they try to run their own tool-models, at least a few of them because HF is so flaky.

I think this paper is pretty significant. It expands the OpenAI Plugin concept with AI-plugins. This is great because you can have a bunch of specialised models combined in countless ways, chatGPT being the orchestrator. It's automated AI pipelines. If nothing else, it could be used to generate training data for a multi-modal model like GPT-4. Could be a good business opportunity for HuggingFace too, their model zoo is impressive.

mjk1093 t1_jegn93v wrote on March 31, 2023 at 9:42 PM

I have found that the spaces tend to get slower the more you use them. It feels like throttling.

RobLocksta t1_jeh1mtc wrote on March 31, 2023 at 11:29 PM

Great post! I've been looking for something like this that would allow me to look at models tuned towards my industry. Sounds like a great place to learn!