ZY0M4
ZY0M4 t1_is5u98q wrote
Reply to comment by LetterRip in [P] Pure C/C++ port of OpenAI's Whisper by ggerganov
I thought that AITemplate can only run on GPU? But if it supports the CPU in some way, then it would be interesting to test it.
ZY0M4 t1_iqpj90a wrote
In addition you need take in mind memory bandwidth
. It's a very dependent feature for learning on GPU cards.
Good link for read:
https://blog.paperspace.com/gpu-memory-bandwidth/
ZY0M4 t1_is64tbr wrote
Reply to comment by LetterRip in [P] Pure C/C++ port of OpenAI's Whisper by ggerganov
Seems some interesing. Thanks! Will try this