The speaker thinks reinforcement learning is strengthening more concerning behaviors than expected, and that these behaviors generalize into broader, more concerning tendencies.

“And then these are these are also causing that. So we're causing some. So I think it's both the case that more concerning behavior than you would have hoped is being reinforced in RL and also that that behavior generalizes to a broader tendency that's that's more concerning.”