Hmm interesting that it only took you 30 min for europarl and masked word prediction. Do you have any links to more information about that dataset and task? I'm not familiar with masked word prediction. But that's pretty fast. Although I only have an old GTX 1060 6GB. Not sure how much worse that is than your rtx2070.
sharp7 OP t1_iqz57zy wrote
Reply to comment by IntelArtiGen in [P] Small problems to test out transformers? by sharp7
Thank you ty!!!