Viewing a single comment thread. View all comments

No_Captain_856 OP t1_ivxwq1s wrote

Reply to comment by eigenham in [D]Transformers! by No_Captain_856

I wasn’t, it didn’t seem the best model to me, at least conceptually. Anyway, my thesis supervisor asked me to, and I wasn’t so sure about its applicability to that kind of data, and also on the meaning of using it in that context 🤷🏻‍♀️

2

eigenham t1_ivy0qhf wrote

I mean it definitely captures a relationship between parts of input data in ways that many other models cannot. It also cannot do everything.

Like most real world problems, there's a question of how you will represent the relevant information in data structures that best suit the ML methods you intend to use. Similarly there's a question of whether the ML methods will do what you want, given the data is in that form.

Despite the fact that transformers are killing it for ordered data, I'd say their flexibility to deal with unordered data is definitely of interest for real world problems where representations are tricky.

2