# Make sure no duplicate content is indexed User-agent: * Disallow: /*?action* Disallow: /*sort=* Disallow: /*msg* # Disallow bots from certain directories User-agent: * Disallow: /cgi-bin/ Disallow: /Sources/ Disallow: /Themes/