Even a small amount of reinforcement-learning feedback and a small parameter change can dramatically alter a model's input-output function.

“So like one thing I want to point out here is that like it doesn't necessarily imply that RRL has a small like effect,”

“Even if you have a few bits and like you only change the parameters a small amount like the actual impact on like function space,”

“the model ends like the input to output map.”

“for mapping”

“can still be like super dramatic you know even if it's like even like one bit can change like your function space a lot and it can like rule out like half the hypothesis space which is huge so like i don't think it's necessarily the case it's like small amounts of bits small amounts of rl once you're starting from a really good point means that like you don't have dramatic impacts in behavior at least like not necessarily”