Viewing a single comment thread. View all comments

techmavengeospatial t1_iyhb01b wrote

Have you thought about buying your own hardware?

For $700-900 You can get recertified dell R820 40 cores/80 threads 256gb ram server with RAID10 SAS drives (8 or 16)

Or if you need GPU $1,100 For an HP Z840 WORKSTATION 24cores/ 48 threads and 128gb ram and 8gb workstation GPU. (we got lucky found one that had 512gb ram and dual GPU)

You can pick these up multiple places or Amazon and Amazon offers no interest financing for 12 months equal payments on amazing credit card. They come with 90 day warranty but can buy an extended warranty

This will pay for itself if you are actively training models and also working with any big data as clouds charge for bandwidth in and out of their systems and offcourse storage

−4

Damitrix t1_iylp66l wrote

I don't think it's remotely feasible for most people to just buy a server for their projects, even excluding a GPU on top.

3

techmavengeospatial t1_iym0rxh wrote

The same thing can be said for someone never standing up server in AWS, GCP, AZURE, VPS, DIGITAL OCEAN.

I don't get your point.

1

Flag_Red t1_iyviyh0 wrote

A 3090 VM around $0.50 an hour on a lot of providers (less if you look around). If you're a hobbyist experimenting 6 hours a day for a week that's $21.00.

Compare to $1100 for the machine you quoted.

2

techmavengeospatial t1_iyvmnho wrote

Your cost did not account for storage and bandwidth

1

Flag_Red t1_iyvpa6i wrote

Using Runpod as an example: bandwidth is free and storage is $0.0013 per GB hour.

If you use a 100GB disk that's an extra $2.87.

2

gyurisc OP t1_izmy3n7 wrote

Is the 3090 VM on AWS? Sounds really interesting. I might give it a try

1

Flag_Red t1_izmzog4 wrote

I use RunPod.

2

gyurisc OP t1_izn1gln wrote

Thanks, I signed up. Are you using the community cloud or the secure one?

1

Flag_Red t1_izn20hg wrote

Typically secure if it's available, community cloud if not. Have a look on "browse servers" for the community cloud instances, their specs can range quite a bit so make sure to get one that fits your use-case.

2

gyurisc OP t1_izmy6am wrote

Interesting idea. Where do you look for these used computers? Are you adding GPUs to the machine or just using them as it is?

1