Another one I can add is that certain security packages (coughSEPcough) can do weird things to the SXS repos that ClickOnce relies on. This will lead to applications failing to install with pretty much useless error messages.

Granted, this 60/40 blame security software/clickonce, but it was a complaint nonetheless.