[Discussion] Compare OpenAI and SentenceTransformer Sentence EmbeddingsSubmitted by Simusid t3_11okrni in MachineLearning
rshah4 t1_jbtsl7o wrote
Reply to comment by rshah4 in [Discussion] Compare OpenAI and SentenceTransformer Sentence Embeddings by Simusid
Also, not sure about a recent comparison, but Nils Reimers also tried to empirically analyze OpenAI's embeddings here: https://twitter.com/Nils_Reimers/status/1487014195568775173
He found across 14 datasets that the OpenAI 175B model is actually worse than a tiny MiniLM 22M parameter model that can run in your browser.
Non-jabroni_redditor t1_jbu2shx wrote
That’s to be expected, no? No model is going to be perfect regardless of how it performs on a set (of datasets) as a whole
JClub t1_jbwu3lx wrote
more than that, GPT is unidirectional, which is really not great a sentence embedder
Viewing a single comment thread. View all comments