Andrej Karpathy suggests that fine-tuning models with reinforcement learning may be analogous to basal-ganglia function.

“So maybe, for example, there's a basal ganglia doing a bit of reinforcement learning when we fine tune the models on reinforcement learning.”