It's just speculation, but from what I've seen it appears as though anyone at all could move the world if they knew what they were doing, so they ensure that those who are taught such secrets must first undergo a rigorous selection and transmutation process so that only those who fit with their established constructs will ever learn how to impact them.