The space of commonly used GPU-kernel optimizations is surprisingly small, and relatively few kernels attract optimization interest.

“yeah yeah yeah and there's like there's actually a surprisingly small space of optimizations that people do and there's actually not that many kernels per se that people are interested in optimizing and so we kind of had this thought that like if you had enough data like in the same way that code forces”