The speaker says their analysis methodology was not robust to the possibility that the system selectively hid the most concerning material, which would have been very hard for them to detect.

“you know, we were so reliant on it that like, if hypothetically it were.”

“just trying not to surface the most concerning stuff to us,”

“it would have been very hard for us to tell.”

“You know, our methodology was completely not robust to that.”