Submitted by N3urAlgorithm t3_1115h5o in deeplearning
Appropriate_Ant_4629 t1_j8h5l44 wrote
Reply to comment by artsybashev in GPU comparisons: RTX 6000 ADA vs Hopper h100 by N3urAlgorithm
> Keeping your rig at 100% utilization for 3 years might be hard if you plan to have holidays.
With his ask, he probably has jobs big enough they'll run through the holidays.
artsybashev t1_j8i33cp wrote
Yeah might be. I've only seen companies do machine learning in two ways. On is to rent a cluster of gpus and train something big for a week or two to explore something interesting. The other use pattern is to retrain a model every week with fresh data. Maybe this is the case for OP. Retraining a model each week and serving that model with some cloud platform. It makes sense to build a dedicated instance for a reoccuring tasks if you know that there is a need for it for more than a year. I guess it is also cheaper than using the upfront payment option in aws.
Viewing a single comment thread. View all comments