fastglow t1_ithe11n wrote on October 23, 2022 at 5:46 PM

Reply to comment by IluvitarTheAinur in [D] Comprehension issues with papers from non-English speakers by Confused_Electron

Fair enough, but as a reviewer, I would point out those errors and expect them to be corrected.

fastglow t1_ithc1il wrote on October 23, 2022 at 5:33 PM

Reply to comment by IluvitarTheAinur in [D] Comprehension issues with papers from non-English speakers by Confused_Electron

I think it is also true that this sentence is very poorly phrased, and that this can be a barrier to comprehension.

fastglow t1_ith39gf wrote on October 23, 2022 at 4:35 PM

Reply to [D] Any pre trained retrieval based language models available? by invertedpassion

Retro doesn't have an open source version at the moment, but doesn't seem like it would be hard to implement, at least on smaller-scale corpora. Dealing with 1.75 trillion-token corpora is a challenge in itself.

fastglow t1_itcge8e wrote on October 22, 2022 at 4:10 PM

Reply to [D] Any pre trained retrieval based language models available? by invertedpassion

RetoMaton: https://github.com/neulab/retomaton

fastglow t1_itcg5l1 wrote on October 22, 2022 at 4:08 PM

Reply to [D] Any pre trained retrieval based language models available? by invertedpassion

RetroMAE is available on the HuggingFace hub: https://huggingface.co/Shitao

fastglow t1_isg4w7v wrote on October 15, 2022 at 6:51 PM

Reply to [D]Use SimCLR as pretraining for image segmentation by Hulord

How about this: https://github.com/bayer-science-for-a-better-life/contrastive-reconstruction