I don't know what he did or didn't do with little children. I do know he wrote or joined a lot of great rulings and the country is better for having had him on the court.
Regarding rumors of what happened at the ranch, there can be all kinds of rumors.