User-agent: *
Allow: /
Crawl-delay: 2

User-agent: GPTBot
Crawl-delay: 5

User-agent: Bytespider
Crawl-delay: 10

User-agent: AhrefsBot
Crawl-delay: 10

User-agent: SemrushBot
Crawl-delay: 10

User-agent: DotBot
Crawl-delay: 10

User-agent: MJ12bot
Crawl-delay: 10

Sitemap: https://photos.kennethreitz.org/sitemap.xml
