IglooAustralia88
IglooAustralia88 t1_iv2x6jf wrote
Reply to comment by JellyfishLoud2643 in [D] ICLR review today? by flyingggToasttt
Got me
IglooAustralia88 t1_iry2a1l wrote
Check BART and/or Longformer, both are available on huggingface
IglooAustralia88 t1_irc52jf wrote
Just my two cents but I would not e.g. choose to go to NYU simply because Yann LeCun is there
IglooAustralia88 t1_ivxpafz wrote
Reply to [D]Transformers! by No_Captain_856
Transformers have no spatial/position knowledge unless you add it explicitly (eg positional embeddings). Otherwise they’re a feed forward network with input specific weights.