Files
kjvstudy.org/kjvstudy_org
kennethreitz 31b1830b45 Reduce crawl-delay to 2s for faster indexing, block /og/ routes, fix duplicate bot
- Crawl-delay 5 → 2 to let search engines index more aggressively
- Disallow /og/ (CPU-heavy image generation, not useful for SEO)
- Remove duplicate 'claudebot' entry in bot logger

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-20 02:21:41 -04:00
..
2025-11-30 21:26:59 -05:00
2025-12-01 13:48:47 -05:00