A search engine uses which program to find pages online

Web crawlers called spiders traverse links and fetch pages for indexing. The index supports fast matching of queries to documents. Wikipedia is a content site not a crawler. Dark web names a hidden network segment. Understanding crawling and indexing explains why some pages rank well for a given query.