# go away User-agent: Googlebot* allow: / User-agent: 154.54. Disallow:/ User-agent: 157.90. Disallow:/ User-agent: 167.71. Disallow:/ User-agent: 20.109 Disallow:/ User-agent: 154.54. Disallow:/ User-agent: 185.2. Disallow:/ User-agent: 5.161.96.225 Disallow:/ User-agent: 5.161. Disallow:/ User-agent: ahrefs.com/robot/ Disallow:/ User-agent: yacybot Disallow:/ User-agent: yacy.net/bot Disallow:/ User-agent: Chrome/41.0.2228.0 Disallow:/ User-agent: Safari/537.36 Disallow:/ User-agent: 41.0.2228.0 Disallow:/ User-agent: Safari Disallow:/ User-agent: AppleWebKit/537.36 Disallow:/ User-agent: AppleWebKit Disallow:/ User-agent: The Knowledge AI Disallow:/ User-agent: Applebot Disallow: / User-agent: Safari/537.36 Disallow: / User-agent: Safari/601.1 Disallow: / User-agent: Safari/ Disallow: / User-agent: SiteLockSpider Disallow: / User-agent: SiteLockSpider [en] (WinNT; I ;Nav) Disallow: / User-Agent: DotBot/1.1 Disallow: / User-Agent: python-requests/ Disallow: / User-Agent: python-requests/2.18.4 Disallow: / User-Agent: SiteLockSpider/ Disallow: / User-agent: AppleWebKit/537.36 Disallow: / User-agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 Disallow: / User-agent: MegaIndex Disallow: / User-agent: MegaIndex.ru/ Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: Transmission/2.42 Disallow: / User-agent: Transmission/2. Disallow: / User-agent: Transmission/ Disallow: / User-agent: Wget/1.12 (linux-gnu) Disallow: / User-agent: Wget/1.12 Disallow: / User-agent: WGet/* Disallow: / User-Agent: cdlwas_bot Disallow: User-agent: Dillo/2.2 Disallow: / User-agent: Dillo/ Disallow: / User-agent: PageNest Free Edition/3.23/ Disallow: / User-agent: PageNest 3.23/ Disallow: / User-agent: PageNest/ Disallow: / User-agent: percolateSPIDERobot/ Disallow: / User-agent: BackStreet Browser/ Disallow: / User-agent: BackStreet Browser 3.1/ Disallow: / User-agent: WebVac/ Disallow: / User-agent: Trident/ Disallow: / User-agent: Yandex/ Disallow: / User-agent: Feedtrace-bot/ Disallow: / User-agent: Voyager/ Disallow: / User-agent: Commons-HttpClient/ Disallow: / User-agent: TweetmemeBot Disallow: / User-agent: Python-urllib/ Disallow: / User-agent: kame-rt Disallow: / User-agent: mxbot/ Disallow: / User-agent: Butterfly/ Disallow: / User-agent: Java/ Disallow: / User-agent: msnbot-NewsBlogs/ Disallow: / User-agent: msnbot/ Disallow: / User-agent: CCbot/ Disallow: / User-agent: DotBot/ Disallow: / User-agent: .NET CLR/ Disallow: / User-agent: LiteFinder/ Disallow: / User-agent: genieBot/ Disallow: / User-agent: YahooFeedSeeker/ Disallow: User-agent: Ask Jeeves/Teoma disallow: User-agent: NutchCVS disallow: / User-agent: Zealbot/ Disallow: / User-agent: VoilaBot/ Disallow: / User-agent: appie/ Disallow: / User-agent: Teoma/ Disallow: User-agent: MSIECrawler/ Disallow: / User-agent: sun4u/ Disallow: / User-agent: HTTrack/ Disallow: / User-agent: Nutch/ Disallow: / User-agent: Sisi/ Disallow: / User-agent: FyberSpider/ Disallow: / User-agent: girafabot/ Disallow: / User-agent: lmspider/ Disallow: / User-agent: NP/ Disallow: / User-agent: Robi/ Disallow: / User-agent: Webster Pro/ Disallow: / User-agent: Webster/ Disallow: / User-agent: Zeus/ Disallow: / User-agent: Gigabot/ Disallow: / User-agent: Slurp/ Disallow: User-agent: Scirus/ Disallow: / User-agent: PicoSearch/ Disallow: / User-agent: Plucker/ Disallow: / User-agent: DISCo Pump/ Disallow: / User-agent: Gulliver/ Disallow: / User-agent: vspider/ Disallow: / User-agent: EmailSiphon/ Disallow: / User-agent: Teleport Pro/ Disallow: / User-agent: Fetch/ Disallow: / User-agent: pamuk/ Disallow: / User-agent: WebCopier/ Disallow: / User-agent: WebCapture/ Disallow: / User-agent: Mass Downloader/ Disallow: / User-agent: WebCopy/ Disallow: / User-agent: AWV0.8d/ Disallow: / User-agent: Crescent Internet ToolPak/ Disallow: / User-agent: JOC Web Spider/ Disallow: / User-agent: WebStripper/ Disallow: / User-agent: SiteSucker/ Disallow: / User-agent: Webdup/ Disallow: / User-agent: Scooter/ Disallow: / User-agent: Python-urllib/ Disallow: / User-agent: Python/ Disallow: / User-agent: Franklin Locator/ Disallow: / User-agent: CK-SillyDog/ Disallow: / User-agent: PocketHTTP/ Disallow: / User-agent: VoilaBot/ Disallow: / User-agent: Xaldon WebSpider/ Disallow: / User-agent: WebCapture/ Disallow: / User-agent: WebStripper/ Disallow: / User-agent: WebReaper/ Disallow: / User-agent: TeragramWebcrawler/ Disallow: / User-agent: Vagabondo/ Disallow: / User-agent: nogoop-HttpClient/ Disallow: / User-agent: Baiduspider/ Disallow: / User-agent: W3CRobot/ Disallow: / User-agent: MyOperaTB/ Disallow: / User-Agent: MJ12bot/ Disallow: / User-Agent: WISEbot/ Disallow: / User-Agent: Exabot/ Disallow: / User-Agent: NaverBot/ Disallow: /