Viewing a single comment thread. View all comments

VirtualHat t1_j6ckblf wrote

Reply to comment by luaks1337 in [N] OpenAI has 1000s of contractors to fine-tune codex by yazriel0

I was thinking next frame prediction, perhaps conditioned on the text description or maybe a transcript. The idea is you could then use the model to generate a video from a text prompt.

I suspect this is far too difficult to achieve with current algorithms. It's just interesting that the training data is all there, and would be many, many orders of magnitude larger than GPT-3's training set.

2

luaks1337 t1_j6clz9v wrote

Ah, I thought you meant that video and audio would be the next step for text mining.

I believe OpenAI confirmed that they already work on a text to video model. My guess would be that current algorithms could do that but that it would be far to expensive to train on videos.

2