treedmt t1_j29v2zd wrote on December 30, 2022 at 6:18 PM

Reply to comment by blueSGL in OpenAI might have shot themselves in the foot with ChatGPT by Kaarssteun

LUCI for one. Not exactly chat format but generative single turn question answering. Http://askluci.tech/QA

blueSGL t1_j29xsiu wrote on December 30, 2022 at 6:35 PM

but that's not what ChatGPT is offering.

Anywhere that is able to do the sorts of things that ChatGPT does will be in a 'loss leader' phase to begin with to attract customers. Or a [x] tokens per month are free, or other marketing trick.

Until inference cost is lower than the cash generated via advertising all services will be losing money, at that point it's either start charging or stop the service.

ChatGPT has succeeded in getting the name out. They are losing money by operating (if the training data they are getting from people is worth less than inference costs) so the solution is to start charging money.

Continually running a product that is in the red to prevent competitors products who are also in the red from succeeding seems like poor decision making in the long term.

treedmt t1_j29yope wrote on December 30, 2022 at 6:40 PM

LUCI is also built on a fine tuned gpt3.5 model, so pretty close to chatgpt in terms of capabilities.

They have a very different monetisation model afaik. They are tokenising the promise of future revenue to monetise, instead of charging customers up front.

> if the training data is worth less than the inference cost.

The thesis is that training data could be worth much more than inference cost, if it is high quality, unique, and targeted to one format (eg. problem:solution or question:answer)

In fact, I believe they’re rolling out “ask-to-earn” very shortly, which will reward users for asking high quality questions and rating the answers, in Luci credits. The focus appears to be solely on accumulating a massive high quality QA database, which will have far more value in the future.

I’m not aware of any rate limits yet but naturally they may be applied to prevent spam etc., however keeping the base model free is core to their data collection strategy.

theRIAA t1_j2ejmws wrote on December 31, 2022 at 5:58 PM

> so pretty close to chatgpt in terms of capabilities

I was impressed that it could give me generic working one-liners, but that is quite far off from writing a working program with 100+ lines of code in all major languages, like ChatGPT can (effortlessly) do. But thank you for the link, it's still very useful.