Un vistazo al robots.txt de la SGAE

1. #11   User-agent: *
   
   Disallow:/portal/
   
   Disallow:/portal/
   Disallow:/wp-*
   
   Disallow:/?SGAE=LADRONES=MONOPOLIO
   Disallow:/?ladrones
   Disallow:/?mafiosos
   Disallow:/?
   Disallow:/?*
   Disallow:/author/
   Disallow:/category/
   Disallow:/portal/
   Disallow:/search/
   Disallow:/home2/
   Disallow:/sg0-no-tocar/
   Disallow:/sg1-no-tocar/
   Disallow:/sg2-no-tocar/
   Disallow:/sg3-no-tocar/
   Disallow:/sg4-no-tocar/
   Disallow:/sg5-no-tocar/
   Disallow:/sg-5-no-tocar/
   Disallow:/sg-4-no-tocar/
   Disallow:/sg-3-no-tocar/
   Disallow:/sg-2-no-tocar/
   Disallow:/sg-1-no-tocar/
   Disallow:/sg*
   Disallow:/search/search-es.jsp?texto=<a href="">ladrones</a>
   Disallow:/search/search-es.jsp?texto=%3Cscript%3Ealert(%22efectivamente,%20somos%20unos%20ladrones%22);%3C/script%3E
   Disallow:/search/search-es.jsp?texto=%3Ch1%3ESomos%20unos%20ladrones%20salgamos%20primeros%20en%20google%20o%20no%3C/h1%3E

   votos: 15  karma: 118  

   el 27-12-2012 17:08 UTC por I--161803--·