I dare say if spy balloons became a real thing (speculating), there would be plenty of people saying "Wow they can't even detect a balloon, how can we be confident they find drones or stop people driving near military bases".

There's an argument on both sides.