# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: / #User-Agent: * #Allow: /calendar/webcal_export/ #User-Agent: * #Disallow: / User-agent: * Disallow: /*?referrer= Disallow: /r/ Disallow: /refer/ Disallow: /partner/ Disallow: /redeem Disallow: /join/ Disallow: /u/ Disallow: /enable_me/ Disallow: /scu/ Disallow: /friends/ Allow: /