>What is it about the email that makes you think you have to respond soon? Is it the culture at the company around email?

Yep. They insist they need answers soon.

(They probably do, but they should just come down to my office or have a proper meeting).

Really, as I said, they're essentially having meetings asynchronously through email.