Is anyone concerned how dependant the industry as it's described here is becoming on one, two or three service providers who take prompts and spit out tokens? And the amount of your proprietary infrastructure you're exposing to them?
Are local models anywhere close to gaining enough capability and traction to do it in-house? Or are there good options for those who'd rather own the capability than rent it?
I don't know, I could envision a situation where investing enough capital in hardware to be able to generate "infinite" tokens for free (or close to that) might open up possibilities not economically practical otherwise. Especially once the incumbents run out of hype / investor money to burn and start raising their prices to push revenue in line with their enormous expenditures.
Also, presumably at some point far in the future we'll reach a technological asymptote and factors like latency may start to play a bigger role, at least for some applications.
I grant that training data is crucial distinguishing factor that may never become competitive in-house.
Are local models anywhere close to gaining enough capability and traction to do it in-house? Or are there good options for those who'd rather own the capability than rent it?