Viewing a single comment thread. View all comments

MrEloi OP t1_j2wlzzz wrote

Reply to comment by iNstein in You can get used computers with 1TB RAM for around 5k - 10k UK pounds ($7k) by MrEloi

Good idea.

I have checked the pricing of 12gb & 24GB GPUs ... not too bad currently.

I suspect that say 5 x 24GB GPUs would come to under $10k.

Add in the special motherboard and maybe we are looking at around $15k for a complete hardware system.

With careful purchasing that could possibly come down to under $10k total.

And, yes, GPT can be run across multiple GPUS, both when training and for running.

1