just tell them you don't want to go to the dinner
if they ask why, either tell them why or just say you don't want to discuss
given your recent excuses for not going, they must know already that you don't like them
if it's your fam, well, you can dislike your family, but still love them