Space rocket propulsion is done by igniting and expelling reaction mass. Same reason why exploding gunpowder will exert kickback even in an empty vacuum chamber. This is basic high school physics shit.
>Rocket exhaust is pushing against nothing.
Wrong. The exploding reaction mass pushes against the rocket, forcing it to move away. Space travel requires you to bring your own molecules to push off, which is exactly what rocket fuel is.