At first, he only freed the South's slaves.
“My paramount object in this struggle is to save the Union, and is not either to save or destroy slavery.”
“…I will say in addition to this that there is a physical difference between the white and black races which I believe will forever forbid the two races living together on terms of social and political equality.”
“You and we are different races. We have between us a broader difference than exists between almost any other two races. Whether it is right or wrong I need not discuss, but this physical difference is a great disadvantage to us both, as I think your race suffers very greatly, many of them, by living among us, while ours suffers from your presence. In a word, we suffer on each side. If this is admitted, it affords a reason at least why we should be separated.”
“And inasmuch as they cannot so live, while they do remain together there must be the position of superior and inferior, and I as much as any other man am in favor of having the superior position assigned to the white race.”
All direct quotes from Lincoln himself.