Except that Manafort is a legit criminal.
So fuck him.
And PapaD was in on it, until he realized he was going to get screwed by them.
As for Flynn, it seems to be an issue of his own making. He's not exactly pushing things to be moved along any faster.
So there is something else going on.