Exarctus t1_jcfmqqs wrote
Reply to comment by 1F9 in [N] PyTorch 2.0: Our next generation release that is faster, more Pythonic and Dynamic as ever by [deleted]
I think you’ve entirely misunderstood what PyTorch is and how it functions.
PyTorch is a front-end to libtorch, which is the C++ backend. Libtorch itself is a wrapper to various highly optimised libraries as well as CUDA implementations of specific ops. Virtually nothing computationally expensive is done on the python layer.
[deleted] OP t1_jcftpu2 wrote
You should look into torch dynamo and torchinductor, a good overview here: https://dev-discuss.pytorch.org/t/torchinductor-a-pytorch-native-compiler-with-define-by-run-ir-and-symbolic-shapes/747
[deleted] OP t1_jcio9zw wrote
[removed]
Viewing a single comment thread. View all comments