Details on proposed search controls (AP)

AP – Under the formal rules for “robots.txt,” a Web site may refuse indexing of the entire site, specific directories or specific pages.