AI that can translate whole videos ?

Submitted by IluvBsissa t3_11cbjfh in singularity

Know Khan Academy ? It's an awesome educational platform with high quality courses made by a former MIT valedictorian Math PhD, Sal Khan.

Problem : all his courses are in English, and most young students from the world don't speak it !

I've seen an AI capable of making a whole multilingual dub for a tv show snippet, while changing lip expression, keeping voice ton, etc.

When will this tool be available for the masses ? There are so many high quality contents out there that most people cannot understand !

14

Comments

You must log in or register to comment.

bach2o t1_ja2kb47 wrote

I mean, with the English transcripts already available, I guess you can just throw it in DeepL and have serviceable translations in many languages. So technically it is available for the masses.

Khan Academy may implement automated translation by themselves, but I think they still need translators to double check.

8

dwarfarchist9001 t1_ja30ctf wrote

The technology to do all the individual steps is already there. It's just a matter of doing it yourself or waiting for some business to do the work for you. I expect such a service will be a available later this year either as a standalone or built in to YouTube Premium.

5

nillouise t1_ja5ot5y wrote

If AI keep develop, it's hard to use the skill you learn in Academy to make money, so, reasonly, you dont need to learn in Academy anymore.

3

naivemarky t1_jabct9a wrote

There is a Chrome extension called Phantom, does something like OP described. It looks promising, especially the first time you use it, but after a while it kind of turns into too much wasted time. Though probably some of you will find a better use of it than I did.
https://youtu.be/1tfrGwJPTsM

1