User-Agent: * Disallow: /admin/ Disallow: /ajax/ Disallow: /assets/ Disallow: /includes/ Disallow: /js/ Disallow: /logs/ Disallow: /templates/ Disallow: /test/ Disallow: /vendor/ Disallow: /search-results.php Crawl-delay: 5 # Block bad bots User-agent: AhrefsBot User-agent: Baiduspider User-agent: Baiduspider-video User-agent: Baiduspider-image User-agent: BLEXBot User-agent: megaIndex.ru User-agent: MegaIndex.ru User-agent: MegaIndex.ru/2.0 User-agent: MJ12bot User-agent: Yandex User-agent: YandexBot User-agent: YandexBot/3.0 User-agent: YoudaoBot Disallow: /