Viewing a single comment thread. View all comments

BUGFIX-66 t1_izphn6n wrote

Really? Can it find the bugs in this code?

https://BUGFIX-66.com

Originally the above site was to demonstrate the incompetence of Microsoft Copilot, but it works for ChatGPT just as well.

This is a test mostly OUTSIDE the training set, and incorrect answers are rejected.

Copilot can solve a few of the simple ones at the beginning (simple matrix multiplication, simple radix sort, etc., that appear often in the training data, and some of the harder ones whose solution appears on GitHub, e.g., the uncorrected prediction/correction compressor/decompressor whose solutions were front-page on Hacker News).

If you paste the puzzles in, how many can ChatGPT solve?

For how many does it need the hint?

0

jsonathan OP t1_izxqy9s wrote

This is unrelated. StackExplain doesn’t find and fix bugs, it explains error messages.

1