Viewing a single comment thread. View all comments

WigglyHypersurface t1_j4grftr wrote on January 15, 2023 at 4:54 PM

Reply to comment by GasZealousideal8691 in [D] Is there any reason hugging face GPT2 would behave (fundamentally) differently from GPT-Neo? by GasZealousideal8691

I think those are the same but make both the causal version and see.

GasZealousideal8691 OP t1_j4gst0f wrote on January 15, 2023 at 5:03 PM

Dont think there is a causal version for GPT2

WigglyHypersurface t1_j4gzweu wrote on January 15, 2023 at 5:47 PM

The GPT2 LM is causal. If you do AutoModelForCausalLM with gpt2 it works fine.