Files
biblical-guide.com/public/robots.txt
Andrei 3ae9733805 Add sitemap and robots.txt, update home page stats to static values, and fix prayer language detection
- Create sitemap.xml with internationalized routes and proper SEO attributes
- Create robots.txt with appropriate crawling rules for public/private content
- Update home page stats to show static values (1,416 Bible versions, 17M+ verses)
- Remove live stats API calls to eliminate loading delays
- Add /api/stats endpoint for potential future use
- Fix Romanian prayers incorrectly tagged as English in database
- Add missing AZURE_OPENAI_DEPLOYMENT to .env.example
- Update translation keys for Bible versions stat
- Add sample English prayer requests to populate prayer wall

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-09-25 06:41:02 +00:00

39 lines
676 B
Plaintext

User-agent: *
Allow: /
# Allow access to public pages
Allow: /en/
Allow: /ro/
Allow: /en/bible
Allow: /ro/bible
Allow: /en/prayers
Allow: /ro/prayers
Allow: /en/search
Allow: /ro/search
Allow: /en/contact
Allow: /ro/contact
# Disallow admin pages
Disallow: /admin/
# Disallow private user pages
Disallow: /*/dashboard
Disallow: /*/profile
Disallow: /*/settings
Disallow: /*/bookmarks
# Disallow API endpoints
Disallow: /api/
# Disallow authentication pages from indexing
Disallow: /*/login
Disallow: /*/auth/
# Allow static assets
Allow: /_next/static/
Allow: /favicon.ico
Allow: /images/
Allow: /icons/
# Sitemap location
Sitemap: https://biblicalguide.com/sitemap.xml