#Googlebot User-agent: Googlebot Allow: *.css Allow: *.js # Other bot spiders User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /?s= # Block malicious crawlers User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Ezooms Disallow: / User-agent: YandexBot Disallow: / User-agent: Sogou web spider Disallow: /