The Vanderbilts were considered new money. They didn't have the old family bloodlines. It took awhile for them to enter high society.
I read somewhere that Commodore Vanderbilt was a drunk they put in place to be the figurehead. Was he the first to need a handler because he was drunk and stupid?