amitraderinthemaking
amitraderinthemaking OP t1_ir8tp7v wrote
Reply to comment by LiquidDinosaurs69 in [D] Fast inferencing in C++ for neural networks by amitraderinthemaking
Out of curiosity did you measure the time? My network is 6 layers deep, 100 units in the hidden layer so it's rather simple.
amitraderinthemaking OP t1_ir8s27e wrote
Reply to comment by LiquidDinosaurs69 in [D] Fast inferencing in C++ for neural networks by amitraderinthemaking
This is something else I was considering. Thank you, I'll take a look and compare times.
amitraderinthemaking OP t1_ir8zuij wrote
Reply to comment by LiquidDinosaurs69 in [D] Fast inferencing in C++ for neural networks by amitraderinthemaking
Ah thank you SO much for sharing I will definitely take a look!
So unfortunately we don't have GPU available on our production systems yet -- we are not an ML oriented team at all (this would be the first project tbh).
But we'd eventually make a case for GPU for certain. Thing is, this method (with ML) should be faster than the current way of doing things before we can move further, you know.
Thanks again for sharing.