killver t1_iwuucud wrote
What exactly do you want to migrate? If you have models in production I am sure you can keep them in production. And for training you can switch fresh to new frameworks like huggingface.
spruce5637 OP t1_iwuzdlt wrote
I have a project in development that's using AllenNLP and I hope to move it out of the framework. My main concern is ensuring everything works like before when I switch over (e.g. the tokenizer, the encoder, the whole data "pipeline")
(Edit: I'm also not sure if I should dig into their source code and compare it with Huggingface to ensure everything works as before under the hood, since reproducibility is really important and all)
killver t1_iwv0pg0 wrote
You didn't really answer my question what parts of your pipeline you want to try to move. But in general AllenNLP is for quite some time now already irrelevant in the space, Id suggest to move to Huggingface asap.
spruce5637 OP t1_iwyh6fe wrote
>You didn't really answer my question what parts of your pipeline you want to try to move.
...almost the whole pipeline? Reading in examples, batching them, tokenization, encoding them into tensors, training, saving, loading for prediction are all built under the framework.
>But in general AllenNLP is for quite some time now already irrelevant in the space, Id suggest to move to Huggingface asap.
Yeah that's the vibe I'm getting, hence the post. Thanks for your suggestions though!
Viewing a single comment thread. View all comments