Viewing a single comment thread. View all comments

redditnit21 OP t1_isn27zi wrote

Reply to comment by danielgafni in Testing Accuracy higher than Training Accuracy by redditnit21

Yeah, I am using dropout layer in the model to avoid overfitting. So am I supposed to remove the dropout layer?

1

First_Bullfrog_4861 t1_isnanri wrote

also: data augmentation will make the training set more complex.

1

redditnit21 OP t1_isnc1yx wrote

There is no data augmentation suing. Should I use data augmentation?

1

Dmytro_P t1_isnljcv wrote

It depends on how large and diverse your dataset is, but in most cases you should. You'd see an even larger difference between the train and test sets.

You can also try to use multiple folds, to train model 5 times for example with the different test set, to check if the test set you selected accidentally contains simpler samples.

2

danielgafni t1_it97yro wrote

Don’t remove it, it’s just how it works. There is nothing wrong with having a higher train loss if you are using dropout.

1