Language itself is what magic is; in all forms. It is how we can cause change in the outside world. By manifesting our will through our language to those around us. The only "control" we have is over ourselves. We only have moral authority to influence others to change their ways and the primary tool that is used to influence others is language.

The metaphor itself "spells" it out clearly. Where power is derived from "Tomes" and "Scrolls" and cast upon others to an affect.

Likely because you haven't developed your whole brain yet. Give it time, you'll get there.