When launching a website, your primary aim is for search engines to locate your website so that visitors can view the content. In order for this to occur, the various search engines have to be able to crawl your web pages and index them so that they can i…