Viewing a single comment thread. View all comments

visarga t1_j46af21 wrote on January 13, 2023 at 1:45 PM

Reply to comment by ml-research in [D] Bitter lesson 2.0? by Tea_Pearce

Exfiltrate the large language models - get them to (pre)label your data. Then use this data to fine-tune a small and efficient HF model. You only pay for the training data.