# Every domain has its own robots txt # If u change something here, it will do so for all domains - see robots-domain-generator.php User-Agent: * Disallow: /*?id=* Disallow: /typo3/ Disallow: /typo3_src/ Disallow: /typo3conf/ Allow: /typo3conf/ext/*/Resources/Public/ Disallow: /typo3temp/ Allow: /typo3temp/assets User-agent: Fasterfox Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: wget Disallow: / User-agent: BlackWidow Disallow: / User-agent: SemrushBot Disallow: / Sitemap: https://www.koppert.nl/sitemap.xml Sitemap: https://www.koppert.nl/news-sitemap.xml