Starting from a strong model, a small amount of reinforcement learning does not necessarily produce only a small behavioral effect.

“can still be like super dramatic you know even if it's like even like one bit can change like your function space a lot and it can like rule out like half the hypothesis space which is huge so like i don't think it's necessarily the case it's like small amounts of bits small amounts of rl once you're starting from a really good point means that like you don't have dramatic impacts in behavior at least like not necessarily”