BUGFIX-66 t1_izphn6n wrote
Really? Can it find the bugs in this code?
Originally the above site was to demonstrate the incompetence of Microsoft Copilot, but it works for ChatGPT just as well.
This is a test mostly OUTSIDE the training set, and incorrect answers are rejected.
Copilot can solve a few of the simple ones at the beginning (simple matrix multiplication, simple radix sort, etc., that appear often in the training data, and some of the harder ones whose solution appears on GitHub, e.g., the uncorrected prediction/correction compressor/decompressor whose solutions were front-page on Hacker News).
If you paste the puzzles in, how many can ChatGPT solve?
For how many does it need the hint?
Viewing a single comment thread. View all comments