Osamabinbush t1_j09pb9w wrote on December 15, 2022 at 1:56 AM Reply to comment by TensorDudee in [P] Implemented Vision Transformers 🚀 from scratch using TensorFlow 2.x by TensorDudee I think you probably didn't train it long enough to reach the interpolating regime if you are over-fitting ViT. Permalink Parent 1
Osamabinbush t1_j09pb9w wrote
Reply to comment by TensorDudee in [P] Implemented Vision Transformers 🚀 from scratch using TensorFlow 2.x by TensorDudee
I think you probably didn't train it long enough to reach the interpolating regime if you are over-fitting ViT.