Egg yolks contain phospholips (far more than the cholesterol content). Both phospholipids and cholesterol make up the cell membrane of every single cell in your body.
Cutting off dietary phospholipids will result in massive malfunction of your body's systems.