leoholt t1_ix5ygsg wrote on November 21, 2022 at 12:16 AM Reply to comment by neuroguy123 in [R] Tips on training Transformers by parabellum630 Would you mind elaborating what a unit-test for the positional encoding is? I'm quite new to this and would love to give it a shot. Permalink Parent 3
leoholt t1_ix5ygsg wrote
Reply to comment by neuroguy123 in [R] Tips on training Transformers by parabellum630
Would you mind elaborating what a unit-test for the positional encoding is? I'm quite new to this and would love to give it a shot.