I believe that's the strongest pattern in LLM gambling. Was listening the Syntax and they described that "Even though theLLM did it wrong 4 times, that 5th time could be right, so why not just go!"; paraphrased of course.
It also explains the meta-LLM business, where all these CEO types put in some question and because the LLM just knows all these words, they believe it's valuable because it's "almost" correct, even when that last correction might be forever elusive because these machines arn't thinking, they're patterning a highly regularized language beneath the more loose descriptions.
There'll definitely be a winner in the AI bubble, but it'll be seen after it pops.
"If it were me and some coworker that made all that text in an afternoon, it would represent a lot of real labor and thought and billable-hours, so it must be valuable!"
