Just get a multi tool and cut off the drywall above the tile. Then pull it off the wall. At least then you have a pre determined line to fix. The way it is now, you'll have to do that anyway, but without any guide, and with way more damage to surrounding areas, likely.