Viewing a single comment thread. View all comments

visarga t1_ivinkvl wrote

Reply to comment by Clean-Inevitable538 in The big data delusion – the more data we have, the harder it is to find meaningful patterns in the world. by IAI_Admin

  1. Take a look at neural scaling laws, figures 2 and 3 especially. Experiments show that more data and more compute are better. It's been a thing for a couple of years already, the paper has 260 citations, authored by OpenAI.

  2. If you work with AI you know it always makes mistakes. Just like if you're using Google Search - you know you often have to work around its problems. Checking models not to make mistakes is big business today, called "human in the loop". There is awareness about model failure modes. Not to mention that even generative AIs like Stable Diffusion require lots of prompt massaging to work well.

  3. sure

9