# Robots.txt file from http://www.searchengineworld.com # test this: http://tool.motoricerca.info/robots-checker.phtml # All robots will spider the domain User-agent: * Disallow: /_ # alle directory's beginnend met _ Disallow: /images/ Disallow: /intranet/