User-agent: * Disallow : /directory/intranet/ Disallow : /directory/intranet/documents/ Disallow : /directory/intranet/internal_documents/ Disallow : /directory/intranet/pdfs/ Disallow : /directory/mba/ Disallow : /directory/mpa/ Disallow : /directory/phd/ Disallow : /temp/ Disallow : /testsite/ Disallow : /ftp/