# Robots.txt file created by http://www.beatlabs.com # For domain: http:// # # This file is used to allow crawlers to index our site. # # List of all web robots: http://www.robotstxt.org/wc/active/html/index.html # # Check robots.txt at: # http://www.searchengineworld.com/cgi-bin/robotcheck.cgi # ## All robots will not spider the domain # ADD Disallow: / to block User-agent: * Disallow: / ## Disallow directory /images/ User-agent: * Disallow: /images/ Disallow: /assets/