releasing [Kernl](https://github.com/ELS-RD/kernl/) under Apache 2 license, a library to make PyTorch models inference significantly faster. With 1 line of code we applied the optimizations and made Bert up to 12X faster than ... wrote custom GPU kernels with the new OpenAI programming language Triton and leveraged TorchDynamo.
**Project link**: [https://github.com/ELS-RD/kernl/](https://github.com/ELS-RD/kernl/)
**E2E demo notebooks**: [XNLI classification](https://github.com/ELS-RD/kernl/blob/main/tutorial/bert%20e2e.ipynb), [T5 generation](https://github.com/ELS-RD/kernl/blob/main/tutorial/t5%20e2e.ipynb)
[Benchmarks ... cores Intel CPU, more info below](https://preview.redd.it/mlo3wvn0d3w91.png?width=2738&format=png&auto=webp&s=1b9dce736ee4c0e371b54b9ef796310f9728660d)
On long sequence length inputs, [Kernl](https://github.com/ELS-RD/kernl/) is most of the time the fastest inference engine, and close to Nvidia TensorRT on shortest ones
DigThatData t1_iu4rr8y wrote
Reply to [D] DL Practitioners, Do You Use Layer Visualization Tools s.a GradCam in Your Process? by DisWastingMyTime
projects I think are interesting, regardless of whether or not I use them myself: * https://github.com/f-dangel/cockpit * https://github.com/f-dangel/backpack * https://github.com/f-dangel/vivit * https://github.com/DistrictDataLabs/yellowbrick * https://github.com/tomgoldstein/loss-landscape * https://github.com/hila-chefer/Transformer-MM-Explainability * https://github.com/pytorch/captum ... github.com/cleverhans-lab/cleverhans * https://github.com/TorchDrift/TorchDrift * https://github.com/MAIF/shapash * https://github.com/uncertainty-toolbox/uncertainty-toolbox * https://github.com/ropas/pytea * https://github.com/oegedijk/explainerdashboard * https://github.com/deepchecks/deepchecks * https://github.com/Trusted-AI/AIX360 * https://github.com/delve-team/delve * https://github.com/CalculatedContent/WeightWatcher * https://github.com/archinetai/surgeon-pytorch * https://github.com/xl0/lovely-tensors