Viewing a single comment thread. View all comments

incrediblediy t1_ir7bljy wrote on October 5, 2022 at 9:20 PM

Reply to comment by minimaxir in [R] Google Colab alternative by Zatania

Yeah! I mean what is the seq_length used by OP :) also the batch size :) I have tried seq_length = 300 but with a small batch size in Colab, specially with AdamW instead of Adam