Viewing a single comment thread. View all comments

Randomramman t1_iwuj1te wrote

Huggingface transformers library is awesome if you want access to TONS of pre-trained, open-source LLMs for fine-tuning. Not sure if it would suit your needs though.

11

spruce5637 OP t1_iwuwi53 wrote

Ah of course, I've been using Huggingface here and there; I think AllenNLP uses some of it in their code too. I guess I should have stuck to using 🤗 and nothing else to begin with lol

The main problem really is how to disentangle my model from AllenNLP without breaking it.

3

new_name_who_dis_ t1_ix1607r wrote

Disentangling your model will involve reading AllenNLP’s source code and taking from it what you need. I don’t think there’s an easier way of doing it

2