# ---------------------- # Generic robots.txt for WordPress # ---------------------- # -- Directives -- User-agent: * # 1) Prevent search engines from crawling the admin area Disallow: /wp-admin/ # 2) Allow AJAX calls for front-end functionality Allow: /wp-admin/admin-ajax.php # 3) Optional: Disallow internal search result pages if you do not want them indexed. Disallow: /?s= Disallow: /search/ # 4) Optional: Sometimes people choose to block plugin/theme directories to avoid indexing # (Be cautious, as it can block CSS/JS files needed for rendering; consider using meta tags or alternative approaches instead) # Disallow: /wp-content/plugins/ # Disallow: /wp-content/themes/ # 5) Optional: If you want to set a crawl delay for certain crawlers (note Google does not follow this) Crawl-delay: 10 Sitemap: https://www.mentaltoughness.partners/sitemap_index.xml