Viewing a single comment thread. View all comments

wojak386 t1_iuqh44r wrote

From my experience:

Inference is good enough, I am using mac mini m1 for it.
Training is hell.
Also a lot of things are still not working, in for example in PyTorch, so be prepared to fight hard with it.
It is cheaper and better to go along with some serious well supported hardware.

My current setup - I have "expensive" local server for ML and stuff, I am connecting to it and work remotely, while my laptops are light and cheap.

1