BLIP from Salesforce is now available on Hugging Face transformers!

Here is a list of cool applications you can build on top of it: https://twitter.com/younesbelkada/status/1605489647395540992

With (I think) most interesting application being building image-captioning APIs and Stable Diffusion-related applications (generate image-text datasets to fine-tune Stable Diffusion on it & image to music app)

Any other thing you have in mind that can be built using BLIP?

Comments

You must log in or register to comment.

matigekunst t1_j14o554 wrote on December 21, 2022 at 5:20 PM

I've used it for an experiment /art piece where BLIP and a diffusion model play the telephone game

younesbelkada OP t1_j1adt9t wrote on December 22, 2022 at 9:04 PM

super cool!!

fraktall t1_j13fns8 wrote on December 21, 2022 at 11:34 AM

Old news? It’s been up for several months already

SergioSV96 t1_j13tgi7 wrote on December 21, 2022 at 1:50 PM

No it hasn't

younesbelkada OP t1_j14eysb wrote on December 21, 2022 at 4:21 PM

no actually the BLIP demo was on the Hub but the model architecture and weights were not on the library yet

SergioSV96 t1_j14jas5 wrote on December 21, 2022 at 4:49 PM

Oh you are right!