By your "person" logic than all illegals need to be counted for purposes of establishing congressional representatives. I think not.
Fourteenth Amendment
Section 2
Representatives shall be apportioned among the several States according to their respective numbers, counting the whole number of persons in each State, excluding Indians not taxed.