Data evaluation is a messy process under high time pressure, with only a few months at best between data collection, model post-training, and launch.

“So it's a, it's a very messy process. It's, uh, uh, y- you're like trying to somehow figure out is this data good and it's all under very high time pressure because the time between collecting the data, post-training the model and launching model is really compressed, maybe a few months at the best.”