--- start of robots.txt # For domain: http://www.itravex.com # All robots will spider the domain User-agent: * Disallow: # Disallow directory /list/ User-agent: * Disallow: /list/ --- end of robots.txt