I need to produce estimates for these metrics. I tried the torchmetrics implementation, however they’re giving me completely wrong results (I tried FID using the same dataset as both real and fake data and it gave me an incredibly high number). Are you guys aware of other available implementations?

Comments

You must log in or register to comment.

buffleswaffles t1_j9rc8aa wrote on February 24, 2023 at 12:27 AM

#1,951,724

Try studiogan's implementation on FID

guru_chicken t1_j9reeor wrote on February 24, 2023 at 12:42 AM

#1,952,010

Check out sg2ada pytorch implementation on github, or Clean-FID!

Skylion007 t1_j9rxyp0 wrote on February 24, 2023 at 3:07 AM

#1,954,967

https://github.com/GaParmar/clean-fid/ is my goto. https://github.com/mseitzer/pytorch-fid isn't bad either.

donshell t1_j9spgvp wrote on February 24, 2023 at 7:36 AM

#1,959,131

I think you are looking for TorchMetrics: https://torchmetrics.readthedocs.io/

PHEEEEELLLLLEEEEP t1_j9wnx8o wrote on February 25, 2023 at 2:22 AM

#1,983,509

Replying to donshell (#1,959,131)

>I tried the torchmetrics implementation, however they’re giving me completely wrong results

ats678 OP t1_ja1imvy wrote on February 26, 2023 at 3:31 AM

#2,013,952

Replying to PHEEEEELLLLLEEEEP (#1,983,509)

Same, the torchmetrics implementation is completely off

toshass t1_ja4klld wrote on February 26, 2023 at 8:14 PM

#2,033,382

Try torch-fidelity : https://github.com/toshas/torch-fidelity