# Mobile Commerce Ltd robots.txt # Change Log: # 2007-12-13 # Allow all devices to # Pick up specific site map files # Crawl the Roundu Lottery service # And nothing else # 2008-08-05 # Speficially allowed and denied folders on AP01 User-agent: * Allow: /sitemap.xml Allow: /sitemap4googlemobile.xml Allow: /roundu/lottery/ Allow: /RoundU/Lottery/ Allow: /RoundU/Horoscopes/ Allow: /roundu/horoscopes/ Allow: /corporate/ Allow: /Corporate/ Disallow: /RoundU/Lottery/LotteryResults.aspx Disallow: /RoundU/Lottery/LotteryEventDate.aspx Disallow: /RoundU/Lottery/lotteryresults.aspx Disallow: /RoundU/Lottery/lotteryeventdate.aspx Disallow: /multimap/ Disallow: /Voda/ Disallow: /aa/ Disallow: /Reporting/ Disallow: /MSN/ Disallow: /msn/ Disallow: /Sport/ Disallow: /Testcard/ Disallow: /AA/ Disallow: /Tiscali/ Disallow: /Orange/ Disallow: /e/ Disallow: /StyleGuide/ Disallow: /O2/ Disallow: /Search/API/ # MS Bing (MSN / Live) User-agent: MSNBot Disallow: / # Here is a list of specific search engine user agents # in case we want to be more specific in future: # For Googlebot # User-agent: Googlebot # User-agent: Googlebot-Mobile # For Yahoo # User-agent: YahooSeeker/M1A1-R2D2 # User-agent: Slurp # Windows Live Search (MSN) # User-agent: MSNBot # DMOZ # User-agent: Robozilla # Alexa/Wayback # User-agent: ia_archiver # End of File