I did genealogy and the census and I never once lost track of an individual or family. Yes, I followed more lines than my own going way back. I could pick any individual and find their descendants. If there had been a tragic flu epidemic, at least a few people would have suddenly vanished in the census. That never happened.