# Robots.txt for CTW updated 6.22.09 User-agent: * Disallow: /pcpo Disallow: /search Disallow: /affiliate-faqs Disallow: /affiliate-thank-you Disallow: /resources Disallow: /thank-you-for-subscribing Disallow: /disclaimer Disallow: /weve-encountered-an-error-subscribing-you Disallow: /trackback/ Disallow: */trackback/ Disallow: /family_main/feed Disallow: */feed Disallow: /family_main/comments Disallow: */comments Disallow: /date/ Disallow: /author/ Disallow: /category/ Disallow: /trackback/ Disallow: */trackback/ Disallow: /feed Disallow: */feed Disallow: /comments Disallow: */comments Disallow: license.txt Disallow: readme.html Disallow: /wp-login.php/ Disallow: /wp-admin/ Disallow: /training/ Disallow: /downloads/ Disallow: /newsitetest/ # File Extensions User-agent: * Disallow: /*.php$ Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.gz$ Disallow: /*.cgi$ Disallow: /*.wmv$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.cgi$ Disallow: /*.xhtml$ Disallow: /*.pdf$