I am looking for someone to write the script I guess for Control Web Crawler This is all I can tell you Its off the Godaddy site.
Use this page to specify what you do and don't want spiders to see on your site.
Determine what pages of your site can be crawled and by whom. Then, create the appropriate [url removed, login to view] file and upload it to the root of your hosted site. If you do not have FTP access to your hosting account, specify your crawling preferences, create the corresponding Meta Tag, and paste it in the section of your site's HTML.
So I am looking for the txt file and or Meta Tag designed for my website
Bu iş için 4 freelancer ortalamada $13/saat teklif veriyor
Hello, We have 4 Year Experienced Team with 40+ SEO Experts and We are INTERESTED for your esteem project. For more details kindly check your Message Board for Affordable and Amazing Services. Thanks