# Robots.txt file # For domain: http://www.modelwarships.com # All robots will spider the domain User-agent: * Disallow: # Disallow directory /working User-agent: * Disallow: /working # Disallow directory /graphics User-agent: * Disallow: /graphics # Disallow directory /links User-agent: * Disallow: /links # Disallow directory /news/stats User-agent: * Disallow: /news/stats User-agent: ia_archiver Disallow: /