Submitted by jaxolingo t3_125qztx in MachineLearning
WokeAssBaller t1_jea0o2f wrote
Reply to comment by LetGoAndBeReal in [D] The best way to train an LLM on company data by jaxolingo
Again you are using an incredibly limited definition of fine tuning based on what the open ai api allows, which once again tells me you don’t know ML.
Fine tuning is ANY additional training on a foundational model, this can be MLM training on the model base or selectively training the subsequent layers.
OF COURSE this can add knowledge as you are doing the same training that got it knowledge in the first place. Glad to see you jumped on the chatgpt band wagon last week, build a transformer from scratch and come talk to me
Viewing a single comment thread. View all comments