User-agent: * allow: / # Blokkeren van bekende malafide scrapers en bots User-agent: BLEXBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: SpamBot Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Scrapy Disallow: / User-agent: Python-urllib Disallow: / User-agent: Java-http-client Disallow: / User-agent: wget Disallow: / User-agent: curl Disallow: / User-agent: HTTrack Disallow: / User-agent: Nutch Disallow: / User-agent: CrawlDaddy Disallow: / disallow: /functions/ disallow: /js/ disallow: /img/ disallow: /css/ disallow: /demos/ disallow: /include/ disallow: /mijn-zone/ disallow: /admin/ disallow: /foutmelding.php* disallow: /quizkalender-detail* disallow: /quizniveau-* sitemap: https://www.quizvragen.eu/sitemap-main.xml sitemap: https://www.quizvragen.eu/sitemap-afbeeldingen.xml sitemap: https://www.quizvragen.eu/sitemap-jaar.xml sitemap: https://www.quizvragen.eu/sitemap-kalender.xml sitemap: https://www.quizvragen.eu/sitemap-quizzen.xml sitemap: https://www.quizvragen.eu/sitemap-tags.xml