User-agent: * Allow: / # Block aggressive crawlers (mostly responsible for non-human traffic spikes) User-agent: Bytespider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: / User-agent: Sogou spider2 Disallow: / User-agent: Baiduspider Disallow: / User-agent: YisouSpider Disallow: / User-agent: 360Spider Disallow: / User-agent: HaoSouSpider Disallow: / User-agent: PetalBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / Sitemap: https://skamper.com/sitemap.xml Sitemap: https://skamper.com/sitemap-videos.xml