kajladk
kajladk t1_is8lqr0 wrote
Reply to comment by ReginaldIII in [N] First RTX 4090 ML benchmarks by killver
But isn't this different? We are comparing raw metric (fps, images/sec) with an aggregate score which might already have ways to eliminate or regularize some outlier metrics in-built
kajladk t1_is8gtdt wrote
Reply to comment by ReginaldIII in [N] First RTX 4090 ML benchmarks by killver
Can anyone explain how taking the max value from 100 runs is a good benchmark when for most other benchmarks (gaming fps etc) the average fps across multiple runs gives a more realistic performance and eliminates any outliers
kajladk t1_isd009f wrote
Reply to comment by afireohno in [N] First RTX 4090 ML benchmarks by killver
Umm, I know mean is more skewed by outliers than median, but it's still "better" than taking the best value