HeinrichTheWolf_17 t1_ja3qorz wrote on February 26, 2023 at 4:59 PM

Open Source options are a great remedy for this issue (See Stable Diffusion). Now we just have to get the same thing for LLMs.

Lesterpaintstheworld t1_ja3w8h5 wrote on February 26, 2023 at 5:35 PM

Several projects are in the way in this direction

el_chaquiste t1_ja48owc wrote on February 26, 2023 at 6:55 PM

Meta's LLaMA seems to be a step in that direction, even if people like E. Yudkowsky doesn't believe it's any good (basically calling Meta's engineers incompetent).

rainy_moon_bear t1_ja7lsd5 wrote on February 27, 2023 at 1:13 PM

It's not open source, and it isn't QAT, so it's behind open-source alternatives for instruct training or RLHF.

Spire_Citron t1_ja56hz2 wrote on February 26, 2023 at 10:43 PM

Yup. As long as there are open source models, things may stop getting better, but they can't get worse. But also they probably will get better, because it's the community that provides a lot of the improvements, not people trying to make money.