light24bulbs t1_je8d6bh wrote on March 30, 2023 at 3:42 AM

Reply to comment by LetGoAndBeReal in [D] The best way to train an LLM on company data by jaxolingo

Continuous retraining is something else.

I'll be training llama soon, I'll get back to you with how it goes.

LetGoAndBeReal t1_je8m6y9 wrote on March 30, 2023 at 5:13 AM

Include new factual statements in your training data like “Joe Biden’s cat is named Fluffy.” Ask the model the name of Joe Biden’s cat before and after training and let us know the answers you get back. See if you get reliable answers across a set of data/questions.