The speaker says it is very important for OpenAI researchers, and ideally third parties, to run counterfactual tests on the model.

“And it's tremendously important for researchers at OpenAI and ideally also at third parties to be able to run”

“counterfactual tests on this model and you can try and do that in a much more secure and hardened way than these evaluations will”