An alternative Q-learning update evaluates all possible next actions and uses the optimal action, as if the optimal path had been taken.

“The other option is well I could go and say instead of just picking the next action which actually happened is I pick the optimal action. Because let's say we have a discrete number of actions,”

“just look at every single one and say well I pick the one which is the best. So effectively you hallucinate a world in which the you actually chose the correct path.”