imaginethezmell t1_jbszsey wrote on March 11, 2023 at 2:03 PM

Reply to comment by Simusid in [Discussion] Compare OpenAI and SentenceTransformer Sentence Embeddings by Simusid

openai is 8k

how about sentence transformer

montcarl t1_jbtexjk wrote on March 11, 2023 at 3:58 PM

This is an important point. The performance similarities indicate that the sentence lengths of the 20k dataset were mostly within the SentenceTransformer max length cutoff. It would be nice to confirm this and also run another test with longer examples. This new test should result in a larger performance gap.

Simusid OP t1_jbt13iy wrote on March 11, 2023 at 2:14 PM

8K? I'm not sure what you're referring to.

VarietyElderberry t1_jbt5zkd wrote on March 11, 2023 at 2:53 PM

I'm assuming u/imaginethezmell is referring to the context length. Indeed, if there is a need for longer context lengths, then OpenAI outcompetes SentenceTransformer which has a default context length of 128.

LetterRip t1_jbtn573 wrote on March 11, 2023 at 4:56 PM

number of total tokens in input + output.

rajanjedi t1_jbt625q wrote on March 11, 2023 at 2:53 PM

Number of tokens in the input perhaps?

[deleted] t1_jbt7rkv wrote on March 11, 2023 at 3:06 PM

[deleted]