If you're interested in what the LPX team has been up to at NVIDIA you should read this excellent tech blog post we just published. Some wild numbers:
We hit 10,996 OTSU speeds (high AL case) on Gemma 4 at full quality
3,431 median OTSU on Gemma 4 for full 100K input context