Viewing a single comment thread. View all comments

halffloat t1_ja8o7s0 wrote

Cool work! You might also enjoy tapenade (tapenade.inria.fr:8080) which takes a C file and then produces a new C source file with the derivative program. It's useful when you want compiled derivatives. I use this a lot for optimization problems; never tried it for NNs, though.

2

JanBitesTheDust OP t1_ja8xmsf wrote

Wow that is impressive. I skimmed through their paper and did not really understand how they implemented it. Nonetheless, it would be cool to try and implement it myself.

1