################################# # YouPosted.com Smart Robots v2 ################################# # I have implemented a smart Robots.txt due to the incompatibility issues between different # robots and whether they support wildcards (*), multiple user-agents and end-anchors ($) # This means that I am now serving a spider-specific robots.txt to Google/Yahoo/MSNbot # and a generic one to every other bot/person. # # Detected Spider/Bot: None # Serving Robots.txt: Generic # # Headers Sent: # Content-Type: text/plain # Expires: Tue, 15 Apr 2008 13:16:46 GMT (2 day validity) # # My Sitemap - I don't provide it just for the fun of it User-agent: * # All Spiders should understand these # Default SMF Folders Disallow: /