Disastrous_Elk_6375 t1_j8hdb2r wrote
Reply to comment by Zondartul in [R] [P] OpenAssistant is a fully open-source chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so. by radi-cho
Do you know if distilling will be possible after instruct finetuning and the RLHF steps? I know it works on "vanilla" models, but I haven't searched anything regarding distillation of instruct trained models.
Zondartul t1_j8i1bdg wrote
Sorry, I just casually watch Yannic Kilcher's YT videos, so I don't know much else.
Viewing a single comment thread. View all comments