That was my belief, too. There would be a TON of pressure on them to do so. Every decision they made would be questioned forever. Their conduct, past and present, would be scrutinized to no end.
What the lawfag didn't mention, btw, is that there's no Constitutional mechanism to "invalidate" a President after he served his term (not that the lawfag didn't discuss it, just that it wasn't mentioned). It would also mean overturning the electoral college's decision, and like it or not, they're actually the ones that pick the President. The EC isn't obligated to do anything other than follow their respective state Constitutions, and even then, there's not much that can be done if they don't.