riceandcashews t1_jdi7iiw wrote on March 24, 2023 at 3:59 PM

Reply to comment by matt2001 in Stanford Researchers Take Down Alpaca AI Over Cost and Hallucinations by matt2001

>The researchers spent just $600 to get it working

This part is a little deceptive. Alpaca is just a modification of the Meta LLAMA models. It cost $600 for Stanford to (with questionable legality) use ChatGPT to modify the LLAMA models. It cost Meta thousands to train the LLAMA models though.

matt2001 OP t1_jdiflq6 wrote on March 24, 2023 at 4:50 PM

Yes. But once you have a bigger system trained, it can be used to train smaller, lower power machines. I am intrigued with the possibility of running it off a laptop or smart phone. I wonder if that would threaten the economic models of the supercomputer versions?

riceandcashews t1_jdihr3n wrote on March 24, 2023 at 5:04 PM

Definitely, the problem is that OpenAI has a non-commerical license that applies to any model trained on it. So Alpaca can not be used for anything other than research purposes legally.

We need a true open LLM to use to train other models legally

ninjasaid13 t1_jdi8ynp wrote on March 24, 2023 at 4:08 PM

>ChatGPT

technically a different gpt was used as far as I know.

riceandcashews t1_jdi9oy4 wrote on March 24, 2023 at 4:13 PM

text-davinci-003

which is the model underlying chatgpt 3

ninjasaid13 t1_jdiag2c wrote on March 24, 2023 at 4:18 PM

but not chatgpt.

riceandcashews t1_jdifhix wrote on March 24, 2023 at 4:49 PM

I mean, text-davinci-003 basically was chatgpt until recently, but sure