#All Crawler Disallowed Crawling All Directry User-agent: * Disallow: / #Root Directry Crawling Allowed allow: /index.php$ #Sub Directry Crawling Allowed allow: /archives/ #MSN Search Web Preview Crawler Disallowed All Pages User-agent: searchpreview Disallow: /