The thing that would get me more excited is how far they could push context coherence before the model loses track. I'm hoping 250k.