# robots.txt file for www.maxwell.ac.uk # this files tells automated search robots which directories # they shouldn't try to index (if they're well behaved) # This is aimed at all search agents: User-agent: * Disallow: /cgi-bin/ Disallow: /internal/ Disallow: /img/