His weakness was that his head was very fucked up and it never got unfucked.
It was only a matter of time before someone listened to the kids/former-kids he manipulated and assaulted. Sure, blackmail happened! That doesn't mean he didn't do anything fucked up. Just means that the kids' parents valued money over justice.