Viewing a single comment thread. View all comments

gmork_13 t1_je7eo4s wrote

Does it have to be a transformer?
Have a look at this model, but it's difficult to answer your question without knowing the compute you have access to: https://paperswithcode.com/method/deit

Browse that site for some alternatives.

1

Nobodyet94 t1_jealqfl wrote

Thanks, well I have a 1660 gtx and 16 gb of ram, and yes it has to be a transformer used for vision. The fact is that I am not creative enough to choose a project ahah.

1

gmork_13 t1_jebwta4 wrote

Just pick the one that doesn't require too much compute (don't go for too high res images) and make sure you can find tutorials or guides for it.

1

Nobodyet94 t1_jegotr3 wrote

is that paper you wrote before fine to replicate? How should I start?

1