https://www.senate.gov/artandhistory/history/common/briefing/Expulsion_Censure.htm
The key point that's sticking out at me in this list of members of Congress being expelled is that they actively supported the Confederate side during the Civil War.
Actively advocating the overthrow of the republic.
Exactly like all the traitorous people whose names we've come to know and hate since we arrived here.