As we approach this pole running off to infinity, what bit of reality will intervene? An infinity in a model indicates you're missing some aspect of saturation or friction that will act to slow things down. Every exponential eventually becomes an s-curve.

Data center space? Electrical power? The amount of training data available? Society's capacity to accept rapid change?