One possible evaluation method is to take an intermediate model checkpoint and use it internally in practice.

“Maybe take an in-between checkpoint and start dogfooding it. Another thing we, we would love to do is, um, take the whole data, um, embed it and then pick up different clusters to see actually it's diverse.”