Llukas88
Llukas88 t1_jdimn2w wrote
Reply to comment by to4life4 in [D] What is the best open source chatbot AI to do transfer learning on? by to4life4
The Alpaca model based on LLaMa isnt. The dataset, which is also called Alpaca is. If you train Bloom, which uses a permissive license, on this dataset, the Bloom license is applied to your finetuned model and you should be able to use it commercially.
Llukas88 t1_jdilkns wrote
There are Alpaca finetuned versions of Bloom or BloomZ on huggingface, maybe try those. Another option would be the Chat version of GPTNeoX from OpenChatKit. Both should be Open Source and free to use.
Llukas88 t1_jdiohwe wrote
Reply to comment by to4life4 in [D] What is the best open source chatbot AI to do transfer learning on? by to4life4
Not any i know of, played around today with Alphacoom (https://huggingface.co/mrm8488/Alpacoom) and got pretty Bad results then tried a BloomZ version (https://huggingface.co/mrm8488/bloomz-7b1-mt-ft-alpaca) and got results similar to the Alpaca-Native model. Maybe read the BloomZ paper it should be a pretty good basis to build a chat model, rest should depend on your Training approach and Data.