I remember when there were no search engines and everything was well indexed you could remember where to surf to get it.
A site called Yahoo turned up to index everything when the data began to grow. Carnegie Mellon University's spider bot web crawler (the first search engine) came after. Commercial versions followed.