Submitted by WigglyHypersurface t3_10jka1r in MachineLearning
WigglyHypersurface OP t1_j5l49mq wrote
Reply to comment by dojoteef in [D] Embedding bags for LLMs by WigglyHypersurface
Thanks these are helpful. Seems like "embedding bag" is used in ML libraries but not always in papers.
Edit: from a quick look neither of these is actually just an embedding bag, rather different approaches to incorporating subword information.
Viewing a single comment thread. View all comments