Viewing a single comment thread. View all comments

yaosio t1_iqu95ip wrote

Reply to comment by Dras_Leona in Self-Programming Artificial Intelligence Using Code-Generating: a self-programming AI implemented using a code generation model can successfully modify its own source code to improve performance and program sub-models to perform auxiliary tasks. by Schneller-als-Licht

They mean is there a way for a third party to prove it. They could be cherry picking or just fabricate their results and with no way to reproduce it we wouldn't know.

2

duffmanhb t1_iqvbiwm wrote

Yes it’s literally a publication up for peer review. The whole point is replication.

3

yaosio t1_iqvqslz wrote

Unless the code is available there's no guarantee it can be replicated. Plenty of people in /r/machinelearning complain about papers that can't be replicated. Sometimes the people writing the paper promise the code and then never provide it and refuse to respond to anybody asking for it.

5