# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain User-agent: * Disallow:/PreTemplatePages/ Disallow: /private_files/ Disallow: /404error.html Disallow: /500error.asp Disallow:/Flash/ Disallow:/Images/ Disallow:/Gifs/ Disallow:/ark_images/ Disallow:/imagesNewsletter/ Disallow:/Library/ Disallow:/_bak/ Disallow:/LRM Draft/ Disallow:/Pluginlab/ Disallow:/Presets/ Disallow:/RobertsPlugins/ Disallow:/Templates/ Disallow:/GoogleImages/ Disallow:/middle_column.psd Disallow:/MSOffice/ Disallow:/_vti_bin/ Disallow:/*.psd Disallow:/*.jpg Disallow:/*.gif