User-Agent: SemrushBot
User-Agent: SemrushBot-SA
User-Agent: SemrushBot-BA
User-Agent: SemrushBot-SI
User-Agent: SemrushBot-SWA
User-Agent: SemrushBot-CT
User-Agent: SemrushBot-BM
User-Agent: SemrushBot-SEOAB
User-Agent: AhrefsBot
User-Agent: DataForSeoBot
User-Agent: MJ12bot
User-Agent: dotbot
User-Agent: Clickagy
User-Agent: barkrowler
User-Agent: BLEXBot
User-Agent: Amazonbot
User-Agent: Applebot
User-Agent: Bytespider
User-Agent: ClaudeBot
User-Agent: GPTBot
User-Agent: OAI-SearchBot
User-Agent: PerplexityBot
User-Agent: PetalBot
User-Agent: meta-externalagent
User-Agent: FacebookBot
Disallow: /

User-Agent: *
Disallow:
Crawl-delay: 5