# For more information about the robots.txt standard, see: # http://www.robotstxt.org/orig.html # # For syntax checking, see: # http://www.sxw.org.uk/computing/robots/check.html Sitemap: https://www.bubbleanddive.com/component/osmap/?view=xml&id=2&lang=nl User-agent: * # do not index error page Disallow: /index.php?option=com_content&view=article&id=43 Disallow: /administrator/ Disallow: /bin/ Disallow: /cache/ Disallow: /cli/ Disallow: /components/ Disallow: /includes/ Disallow: /images/assets Disallow: /images/multithumb_thumbs Disallow: /images/sampledata Disallow: /installation/ Disallow: /language/ Disallow: /layouts/ Disallow: /libraries/ Disallow: /logs/ Disallow: /modules/ Disallow: /plugins/ Disallow: /tmp/ User-agent: Slurp Allow: /y_key_043593801ede5a17.html Allow: /y_key_e8a235617562106f.html Disallow: /