>Installing software is a task which should be left to AI.

I think the subtext here is actually revealing a deeper issue. Installing software sucks. It’s error prone and every project does it a slightly different way. What we need is standardization, and I can see why prose could be an attractive middle ground. Easier to understand but less precise may result in marginally better outcomes.

I’m concerned that this approach serves to fix the obvious problems while simultaneously introducing subtler problems.

Tangentially, I’ve been thinking about this a lot lately. There are projects like nix that are excellent at fixing a lot of problems in the software packaging and installation space that are great from a security perspective but are famously difficult to use. I’d personally like to see more work leveraging AI to increase the accessibility of these paradigms and not throw the bathwater out with the baby, so to speak.