Web Designing India Web Hosting India SEO Services India Software Development India Free SEO Tools
Ultimate Web Solutions - Ultimate Web Solutions India -
Webmaster Articles, Submit Site Free Web Directory,
Web Marketing Articles by SEO Company India
India SEO Services & India Web Hosting Company
 

Create Robots Txt

A robots txt is a text file uploaded to your website server to keep compliant search engine robots from indexing particular pages of your website. Create a robots txt file like this

User-agent: Search Engine Robot Name
Disallow: File or Directory

Ex.

User-agent: Googlebot
Disallow: /adcampaign1.html

or

User-agent: *
Disallow: /adcampaign1.html

The * is used to cover all compliant search engine robots.

Common Robot Names

Search engine robots follow links throughout the Internet to crawl through all the websites on the world wide web. Here's a list of top search engine robot names:

Google -----> googlebot

Ask Jeeves -----> Teoma

Alta Vista / Yahoo / All the Web / Inktomi -----> Slurp

Check Your Robots txt on Search Engine World's Robots.txt Validator.

About The Author: SEO Consultant - Offers search engine optimization, link popularity building and search engine friendly website design services.
 

Search Engine Forum for Web Professionals

Web Solutions Services
» Website Designing
» Quality Web Hosting
» Domain Registration
» SEO Services India
» Software Development
» WebMaster Forum
» Articles Submission Directory
» Submit Your Article
   
» All Articles
» May 2005
» June 2005
» July 2005
» August 2005
» September 2005
» October 2005
» November 2005
» December 2005
» January 2006

Site Map
- Link Exchange Directory - Search The Directory - Article Disclaimer -