Submitted by HenrAInet t3_126i01q in deeplearning

In the context of my thesis, I'm currently researching on Label Smoothing.

Does anyone know of any papers or other articles on applying label smoothing not generalized to all training data, but only to specific data?

Thanks!

​

EDIT:

The basis of the thesis is a project that focuses on the classification of exact vehicle models. The results of the model are basically good. However, in some cases it is difficult to clearly identify the vehicle model - i.e. there is no clear ground truth. For example, it may not be possible to distinguish whether a car photographed from the front or the rear is a station wagon or a sedan, or whether it is a convertible or a coupe. Currently, my model gives an incorrect prediction with a high probability for such an inconclusive ground truth, indicating that the DNN has little or no uncertainty and is not well calibrated.

A possible approach would be to apply label smoothing, but not generalized to all training data, but only targeted to specific data and specifically to those with inconclusive ground truth, to give/train the model more uncertainty in these situation.

5

Comments

You must log in or register to comment.

processeurTournesol t1_jedunkk wrote

Not directly related to label smoothing but some ideas may be worth looking into: " Preventing Manifold Intrusion with Locality: Local Mixup"

2

incrapnito t1_je9vtgb wrote

Not sure what you mean by specific data. Here is a good read - When Does Label Smoothing Help? (https://arxiv.org/pdf/1906.02629.pdf)

1

HenrAInet OP t1_jea7qof wrote

Thank you for suggesting this paper! I have already read it and found it quite informative.

Regarding your question about what I meant by 'specific data', my plan is to use label smoothing only on selected training data, rather than applying (generalized) label smoothing to all training data.

Currently, I'm seeking more knowledge on such 'data-specific' label smoothing. Hope this clears things up!

1