User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php AI Crawlers (allowed) User-agent: GPTBot Disallow: User-agent: Google-Extended Disallow: User-agent: CCBot Disallow: Sitemap: https://farrismd.com/sitemap_index.xml