MrOfficialCandy OP t1_j7r85li wrote on February 8, 2023 at 9:01 PM

Reply to comment by like_a_tensor in [D] Is English the optimal language to train NLP models on? by MrOfficialCandy

That doesn't help at all. Reading tokens at the byte level does not stop the word "they" or "it" from being vague in the context of a sentence.

like_a_tensor t1_j7rbdno wrote on February 8, 2023 at 9:21 PM

Sounds like you want something like a logical representation of sentences. Reducing sentences to first order logic might be what you're looking for. There's also AMRs (Abstract Meaning Representations). The problem with AMRs is that they need to be built, which is non-trivial for machines and time-consuming for humans.