Viewing a single comment thread. View all comments

londons_explorer t1_is9c1xs wrote

This seems to basically be injecting a tiny amount of rule-based decision making into a language model...

The physics model is so limited that it can only work in a very tiny number of cases, and the results might as well be hardcoded prompts to inject.

26

visarga t1_is9mzus wrote

We need a learned physics model, there's so much video to train on, it's one of the most neglected modalities.

18

Icy-Pause-574 t1_isb5gai wrote

But we are using physics engine / game engine to create the virtual world right?

I think this paper shows some potential of using the parallel world to help understand the real world, which is amazing.

I want to call it the milestone of mix-reality LMs.

7