Viewing a single comment thread. View all comments

killver t1_iz013vj wrote

Reply to comment by MUSEy69 in [D] Model comparison (train/test vs cross-validation) by Visual-Arm-7375

> you should always have an independent test split

nope, this is not true

−7

[deleted] t1_iz07acr wrote

Please elaborate. Are you suggesting that we should hyperparameter-tune on the test set?

6

killver t1_iz0a6xk wrote

No the opposite. So why would you need a test set?

I am arguing that the test data is basically useless, because if you make a decision on it based on performance it is just another validation dataset, and if not you can better use the data for training.

−2