In order to not be able to run again, a president has to first be convicted in the senate. Then I believe they vote on an additional measure that would prohibit the person from holding office in the future.
People that want to cause trouble will do so regardless.