# GlobalCoders - Robots.txt # https://globalcoders.app # Sitemap location Sitemap: https://globalcoders.app/sitemap.xml # Google User-agent: Googlebot Allow: / Disallow: /dashboard Disallow: /profile Disallow: /checkout/* Disallow: /auth/* Disallow: /meeting/*/simulate Disallow: /interview-feedback/* # Bing User-agent: Bingbot Allow: / Disallow: /dashboard Disallow: /profile Disallow: /checkout/* Disallow: /auth/* # Social Media Crawlers (for link previews) User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / # All other bots User-agent: * Allow: / Disallow: /dashboard Disallow: /profile Disallow: /checkout/* Disallow: /auth/* Disallow: /meeting/*/simulate Disallow: /interview-feedback/* Disallow: /user # Crawl-delay for respectful crawling (optional) Crawl-delay: 1