The problem here is how the bot was “taught”. If they fed it various cases and it learned via previous human choices then it’s just going to perpetuate the same outcomes and reinforce an already problematic system.