User-agent: * # SEARCH ENGINE SITEMAP # Big Medium builds a sitemap that tells search engines # the location of all of the pages on your site. # If your site's homepage directory is in your web root: # http://www.example.com # # ...then your sitemap is located here: # http://www.example.com/bm~sitemap_index.xml # # ...and the entry should be: #Sitemap: http://www.pelsmakers.be/bm~sitemap_index.xml #block Webalizer directories ------------------ #block directories ------------------ Disallow: /cgi-bin/ Disallow: /assets/ Disallow: /mp/ Disallow: /files/ #block page-directory support files ------------ #these examples assume that your page directory #is located at: http://www.example.com/bm #Disallow: /bm~comments/ #Disallow: /bm~theme/ #Disallow: /bm~assets/ # # ##block indexing of email and print pages ------- #Disallow: /*~email.shtml #Disallow: /*~print.shtml