barvazduck

barvazduck t1_j1yl9s5 wrote on December 28, 2022 at 10:23 AM

Reply to comment by peno8 in [D] Is 16gb ram for macbook pro enough for ML?? by peno8

I work on LLMs and it's my setup (I have M1 32gb, though it has little influence as everything is done on colab/server jobs).

Local decice can have more influence if you plan to use the laptop for testing/inference colab made model.

barvazduck t1_j06dikt wrote on December 14, 2022 at 11:55 AM

Reply to [D] What would happen if you normalize each sample on its on before sending it to the neural net? by xylont

I also like to add another value like scale that hints at the pre-normalized size. That way an ocr model a handwritten period and zero won't seem the same (also relevant for other goals)