# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # Welcome robots User-agent: * Allow: / User-agent: AwarioBot User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: BLEXBot User-agent: PetalBot User-agent: SemrushBot User-agent: DotBot User-agent: oBot User-agent: AhrefsBot User-agent: Domains Project User-agent: MJ12bot User-agent: barkrowler User-agent: Bytespider User-agent: Amazonbot Disallow: /