SPEAKER_03 suggests that domain-specific reinforcement learning can encode useful intuitions in model weights and improve runtime efficiency, even if models could otherwise learn the domain on the fly.

“and you could argue that you need to do a lot of this domain-specific training just to make them more efficient.”

“So even if they were smart enough to figure this out on the fly,”

“you still might want to do a bunch of RL and bake all these intuitions into the weights so the model would be more efficient at runtime.”