I use iMazing, which now requires the passcode. A significant pain since I keep my iPadMini by my bed at the other end of my house! The net effect of this requirement is that I've turned off automatic back-ups and now only back-up manually and much less frequently!

There should be an option to limit access to the devices to the same LAN as the backup computer or perhaps the specific IP address of that computer.