Viewing a single comment thread. View all comments

Wyrade t1_j9ig088 wrote

Can someone explain the pricing for me?

I'm just a random guy, not in business, but I'm curious.

For example, is gpt3.5 turbo 100 computing units per instance, costing $26/month PLUS $260/month per unit, meaning $26026 per month for a single instance? And how many people can a single instance serve?

The above doesn't sound right to me, but I'm confused.

5

maskedpaki t1_j9ilkeq wrote

it seems like its 6 times more expensive than chatgpt given the relative pricing

​

since chatgpt costs a few cents per query we can expect this to cost a few tens of cents per query.

​

But the queries can be like 20,000 words of context which allows it to write like whole programs entire research papers short books etc

10