Viewing a single comment thread. View all comments

PlayOffQuinnCook t1_iu7ualp wrote

Congrats on open sourcing! Quick question on fusion - how do you guys fuse layers like conv, bn, relu, etc, if they are not named conv1, bn1, relu in the nn.Module.

1

PlayOffQuinnCook t1_iu7ug9w wrote

Oh I guess the library supports accelerating a couple of well known models defined in the models module?

2

harishprab OP t1_iucy0ne wrote

We use the TorchFX library to do this on CPU. And TensorRT is doing this for GPU. We’re not using any custom function for the fusing. TorchFX and TensorRT are doing it anyways

0

PlayOffQuinnCook t1_iueq6l4 wrote

I understand that. But let’s say I have these operators named as c1, b1, r1 instead of what it expects, the fusion logic won’t work. So my question was if this library works only a fixed set of models defined in the library itself or it can work against any models users write.

1