Viewing a single comment thread. View all comments

Hamoodzstyle t1_iqsmn0k wrote

Also do l don't forget, no ablation study so that it's impossible to know which of the tiny changes actually helped.

61

maxToTheJ t1_iqt2dov wrote

This. Using a single "lego block" would be an improvement.

22

crrrr30 t1_iqta3tc wrote

using a single lego block WITH different optimizer, lr schedule, and augmentations…

8