Apprehensive_Air8919 OP t1_jacst55 wrote on February 28, 2023 at 2:47 PM Reply to comment by trajo123 in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919 omg... I think I found the bug. I had used the depth estimation image as input for the model in the validation loop.................... Permalink Parent 2
Apprehensive_Air8919 OP t1_jackmpu wrote on February 28, 2023 at 1:46 PM Reply to comment by trajo123 in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919 I just did a run with test_size being 0.5. The same thing happend. Wtf is going on :/ Permalink Parent 1
Apprehensive_Air8919 OP t1_ja96vdu wrote on February 27, 2023 at 7:43 PM Reply to comment by trajo123 in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919 nn.MSELoss(), I used sklearn train_test_split() with test_size being = 0.2. It is consistent behavior across any split i've seen. The wierd thing is that it only happens when I run very low lr Permalink Parent 1
Apprehensive_Air8919 OP t1_ja94rat wrote on February 27, 2023 at 7:29 PM Reply to comment by alam-ai in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919 good analogy! Yes I use model.eval() so dropout is removed when doing the forward pass on the validation set. Permalink Parent 1
Apprehensive_Air8919 OP t1_ja8mxcj wrote on February 27, 2023 at 5:37 PM Reply to comment by Oceanboi in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919 The size of the testing data is 20%, and dropout is 10%. I am not sure how I could be leaking information Permalink Parent 1
Why does my validation loss suddenly fall dramatically while my training loss does not? Submitted by Apprehensive_Air8919 t3_11dfgfm on February 27, 2023 at 4:06 PM in deeplearning 12 comments 1
Apprehensive_Air8919 OP t1_jacst55 wrote
Reply to comment by trajo123 in Why does my validation loss suddenly fall dramatically while my training loss does not? by Apprehensive_Air8919
omg... I think I found the bug. I had used the depth estimation image as input for the model in the validation loop....................