For customer tasks, the speaker says they generally do not train on customer data; instead, they create evaluations and synthetic data approximating the tasks, which can yield good generalization.

“you can generate data because it's not even that you're going to be training on the customer's data,”

“it's more that you're setting up evaluations,”

“and if you can set up a good evaluation for their tasks, then you can generate synthetic data that approximated and you get”

“get good generalization.”