[D] Are GAN(s) still relevant as a research topic? or is there any idea regarding research on generative modeling? Submitted by aozorahime t3_y2nyn5 on October 13, 2022 at 3:19 AM in MachineLearning 34 comments 67
skelly0311 t1_is8d9xa wrote on October 14, 2022 at 1:12 AM ELECTRA, which is a transformer variant of BERT uses a GAN in the pre training phase in order to get rid of the mask tokens discrepancy from transforms such as BERT and RoBERTa. https://arxiv.org/abs/2003.10555 Permalink 1
Viewing a single comment thread. View all comments