They have a little trick to avoid that. A few members that stay in town (or come back to town) agree to meet for a few minutes every several days and then the congress is technically not in recess.
It's just another way that congress blocks the president from getting anything important done when they are out of town. Frustrating as hell when your President is from your party, but useful as hell when the President is Obummer.