_Arsenie_Boca_ t1_iu7yz56 wrote on October 29, 2022 at 6:58 AM

Looks promising. A comparison with other competitors (hf accelerate, neuralmagic, nebullvm, ...) would be great

harishprab OP t1_iucy9k9 wrote on October 30, 2022 at 11:43 AM

Thanks. HF accelerate is basically doing it for intel chips. I haven’t seen them support TensorRT. I could be wrong. Neural Magic is mostly about quantisation aware training and pruning techniques. We focus on post training techniques. We should try Nebullvm. They’re a great library too.