# robots.txt for https://recoverfiber.com/ sitemap: https://recoverfiber.com/sitemaps-2-sitemap.xml # live - don't allow web crawlers to index cpresources/ or vendor/ User-agent: * Disallow: /cpresources/ Disallow: /vendor/ Disallow: /.env Disallow: /cache/ Disallow: *?topic=* Disallow: *?utm_source=* Disallow: *?utm_medium=* Disallow: *?utm_campaign=* Disallow: *?field_cecon_email=* Disallow: *?cert=* Disallow: *?filters&topic=* Disallow: *sortOrder=* Disallow: *?source=* Disallow: *?gclid=* user-agent: AdsBot-Google Allow: / user-agent: AdsBot-Google-Mobile Allow: / user-agent: Googlebot-Image Allow: / user-agent: Mediapartners-Google Allow: /