Look who wrote about Q learning…. Interesting! Any relation to Jim Watkins?
Q-learning(Watkins, 1989)is a simple way for agents to learn how to act optimally in controlled Markovian domains. It amounts to an incremental method for dynamic programming which imposes limited computational demands. It works by successively improving its evaluations of the quality of particular actions at particular states.
https://link.springer.com/article/10.1007/BF00992698