# Dont allow search engines to index specific folder User-agent: * #Crawl-delay: 10 Sitemap: https://toonado.com/sitemap/ Disallow: /gatrack/* Disallow: /members/* Disallow: /plugins/* Disallow: */.ashx Disallow: /*.axd Disallow: /*.axd Disallow: /*.js Disallow: /ScriptResource.axd Disallow: /WebResource.axd Disallow: /scriptresource.axd Disallow: /webresource.axd # Meta AI crawlers opted out 2026-09-08 - they were inflating article view counts by # fetching the view pixel, and return effectively no referral traffic. # NOTE: facebookexternalhit (link previews for Facebook/Instagram) is deliberately NOT # listed here and must stay allowed. User-agent: meta-externalagent Disallow: / User-agent: meta-webindexer Disallow: /