User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Mercator User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: htdig User-agent: spider00.logika.net User-agent: NetMechanic User-agent: libwww-perl User-agent: Teleport Pro Disallow: /rss.xml User-agent: * Disallow: /_private/ Disallow: /test/ Disallow: /templates/ Disallow: /search/ Disallow: /poll/ Disallow: /menu/ Disallow: /$/billeder/link banner/ Disallow: /$/musik/m3u/ Disallow: /$/musik/wma/ Disallow: /$/musik/mp3/ Disallow: /$/musik/*.asp Disallow: /$/musik/playlist.htm Disallow: /$/film/*.asp Disallow: /$/film/mpeg/ Disallow: /$/film/m3u/ Disallow: /$/film/wmv/ Disallow: /$/film/*.jpg Disallow: /wap/ # updated 2006-12-19 (nre robot)