ojiber OP t1_iux5uw3 wrote on November 3, 2022 at 5:41 PM

Reply to comment by bluuerp in [P] How to reverse engineer a neural network to get inputs from the outputs by ojiber

Hi, I had a quick look into gradCam and it seems to be very complex. Do you have any good resources on it?

ojiber OP t1_iux0nqf wrote on November 3, 2022 at 5:08 PM

Reply to comment by limpbizkit4prez in [P] How to reverse engineer a neural network to get inputs from the outputs by ojiber

That would be fantastic thanks!

ojiber OP t1_iux06k8 wrote on November 3, 2022 at 5:05 PM

Reply to comment by nins_ in [P] How to reverse engineer a neural network to get inputs from the outputs by ojiber

Thank you, I think this is a nice fallback idea if all else fails. I'd like to be able to use some more sophisticated methods to identify regions of parameter space that come close to producing a set of outputs but this could be a place to start.

And looking at their post history, no I don't think that is my partner. Just another student with a similar problem in need of people to bounce ideas off of. :)

ojiber OP t1_iuwzhvf wrote on November 3, 2022 at 5:00 PM

Reply to comment by MLFanatic1337 in [P] How to reverse engineer a neural network to get inputs from the outputs by ojiber

>This would take a lot of time most likely and could be a false positive

Could you use a gradient approach to speed this up? I don't know how you would do this, but if you could find the gradient of the search space you could use this to try and minimize for a certain set of parameters.

What do you think?

ojiber OP t1_iuwyf8p wrote on November 3, 2022 at 4:54 PM

Reply to comment by iCameToLearnSomeCode in [P] How to reverse engineer a neural network to get inputs from the outputs by ojiber

I had thought of this but unfortunately, I don't think that I have enough information in my output variables to be able to predict the inputs. When reversing the network the error bounces around and my accuracy stays consistently at ~10%.

ojiber OP t1_iuwy5xs wrote on November 3, 2022 at 4:52 PM

Reply to comment by bumbo-pa in [P] How to reverse engineer a neural network to get inputs from the outputs by ojiber

I'm sorry I don't understand, are you saying that I answered the question in that you cannot do it? That you can't predict a likely input parameter for a network using a set of known outputs? It seems like you very much can do this, but that my approach to solving the problem is wrong. Do you have any suggestions as to how this could be done?