Apprehensive_Air8919
Apprehensive_Air8919 OP t1_jackmpu wrote
Reply to comment by trajo123 in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919
I just did a run with test_size being 0.5. The same thing happend. Wtf is going on :/
Apprehensive_Air8919 OP t1_ja96vdu wrote
Reply to comment by trajo123 in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919
nn.MSELoss(), I used sklearn train_test_split() with test_size being = 0.2. It is consistent behavior across any split i've seen. The wierd thing is that it only happens when I run very low lr
Apprehensive_Air8919 OP t1_ja94rat wrote
Reply to comment by alam-ai in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919
good analogy! Yes I use model.eval() so dropout is removed when doing the forward pass on the validation set.
Apprehensive_Air8919 OP t1_ja8mxcj wrote
Reply to comment by Oceanboi in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919
The size of the testing data is 20%, and dropout is 10%. I am not sure how I could be leaking information
Apprehensive_Air8919 OP t1_jacst55 wrote
Reply to comment by trajo123 in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919
omg... I think I found the bug. I had used the depth estimation image as input for the model in the validation loop....................