Viewing a single comment thread. View all comments

blose1 t1_j12voe0 wrote

Reply to comment by Purplekeyboard in [R] Nonparametric Masked Language Modeling - MetaAi 2022 - NPM - 500x fewer parameters than GPT-3 while outperforming it on zero-shot tasks by Singularian2501

GPT-3 is like yesterday news, SOTA is chatGPT and it does circles around real world GPT-3 on every possible task.

−18

RealGrande t1_j12zfl6 wrote

ChatGPT is a fine-tuned version of gpt3 (well, gpt3.5 but pretty much the same barring some improvements)

16

blose1 t1_j14q7ul wrote

Have you actually tried both on same tasks? I mean it seems like a lot of people here read a paper and some blog and make their conclusion without even using the tool, I've used both on the same tasks, compared on hundreds of real world cases and yes it's fine-tuned GPT3 but with human assisted RL and it's doing circles around GPT-3 in question answering, COT and code generation.

2

ShowerVagina t1_j13gxva wrote

GPT-3 is still the best for general use. Or for story writing. Novel AI is good, but still not as good as GPT-3.

1

blose1 t1_j14qfir wrote

Have you compared both yourself on question answering, COT and code generation ?

1