Submitted by justundertheblack t3_114elpg in MachineLearning
No_Dust_9578 t1_j8vv85i wrote
Few things. Don't make a model from scratch, use a pre-trained one. There are plenty on hugging face. Another thing, later on, if you have your own data, you can use it to fine tune those models to better suit your task. This is a general approach to ML applications where data isn't available or not enough. Side note, speaking from experience, those large sentiment models that are out there do have great performance but some of them have been trained with large sentiment datasets that have inconsistencies. For instance, once I had to validate manually the performance on my data and noticed that the pre-trained models predicted the following sentence as POSITIVE sentiment but to a human, this is not positive: "oh yay, I love cold food...". So be careful and setup some sanity checks. Don't fully assume the predictions are accurate.
justundertheblack OP t1_j8vvt1i wrote
Thanks for this man
justundertheblack OP t1_j8vvwgw wrote
btw this is a school project so we have to train our own model and we have the dataset for it too so do you know any good ones?
No_Dust_9578 t1_j8vw117 wrote
Ah I see. In that case something like this should give you a good direction.
justundertheblack OP t1_j8vw3f2 wrote
this seems good I'll look into it
No_Principle9257 t1_j8wwrky wrote
justundertheblack OP t1_j8wy90j wrote
i fs will 👍
Viewing a single comment thread. View all comments