Could HAVE. There is no such thing as "could of". You're trying to say "could've" and are hearing "could of". It makes an otherwise reasonably eloquent individual sound like a moron. "Could have" or "could've". Make that note. Jesus.
Or maybe you're a moron.