If your ancestors were slaves instead of slave owners, and you happened to work at the court house or even visit it, do you think you might get a different feeling seeing the portrait?
I don't believe they're trying to revise history, just to make more people feel welcome and comfortable.
What may be a good compromise is putting these statues and portraits in their own library or Hall of Shame.