Submitted by raulkite t3_10npo34 in deeplearning
Comments
raulkite OP t1_j6a70ru wrote
perrohunter t1_j6abuz7 wrote
For machine learning workloads the M2 Max will show a substancial difference so I’d recommend you go with the M2 Max
Rude_Ad_4174 t1_j6bdock wrote
I’m total noob in this space, but i agree it’s probably better to have just M2 or M2 Pro and notebook running on a remote server with Nvidia GPU than having M2 Max. But with M2 Max now it can have 96gb memory so I’m curious how much difference it makes 🤔
Fourstrokeperro t1_j6cm2c0 wrote
What? Is there a second slide?
Ayakalam t1_j6fevds wrote
How is the neural engine invoked in your typical MacBook training session on PyTorch ? Is that what automatically gets used if you train in cpu ? Gpu ?
raulkite OP t1_j6h7xth wrote
Explanation in source link. https://twitter.com/danielgross/status/1619417503561818112.
It’s a implementation using neural engine. And it’s near half A100 performance doing interference
raulkite OP t1_j6a41la wrote
Is it worthwhile to move from buying m2 pro 32 gb to m2 max 64gb? My feeling is no and continue running notebooks on the server. But the possibility of run little training and test fluently in the laptop is soooo interesting 🤔
Neural engine seem the same for both models
Interested in opinion