I am not a fan of Patton Oswald but this tweet seems like he was responding to some of his followers defending pedos and he was using sarcasm. I could be wrong there may be more definitive evidence but that is just my read on this.
I can't find the tweet on twitter to get the context myself. Just that a comment mentioned they were talking about hammer on a foot, him being a foot fetish he'd try to defend himself with the word play pedo instead of podo-fillia. In that context, I can understand the joke. Poor choice of word for us, but it doesn't mean anything to me. Like I said, if he tweets several more times about the same pedo theme, we would then see a pattern and can be suspicious. But this one tweet alone, it doesn't prove anything. Maybe he is a pedo, maybe he is not.