Find us elsewhere
Join Now Member Login

Is Your Robots.txt File Installed Correctly?

 
New Topic
Post Reply
Follow Topic
Page of 1
  • Author
  • Message
 
WebBizIdeas

posts: 125

Oct 08, 2008 5:39 PM ET    Quote  Report Abuse
Points: 0   Vote
Hi,

We just upload a tutorial on Robots.txt files you can read here.  Let me know what you think and how important you feel robots.txt files are.

What is a Robots.txt File?
vwebworld

posts: 1237

Oct 08, 2008 6:18 PM ET    Quote  Report Abuse
Points: 0   Vote
One other thing to do is to add the url of your sitemap file into the robots.txt file:
 
By adding this code to the robots.txt file:
sitemap: http://www.yoursite.com/sitemap.xml
 
Using your domain name and the name of your sitemp file.
 
~Roland


-------------------------

Web Design | Best Beef Jerky | ecommerce articles | Follow vwebworld on Twitter
Page of 1
Post Reply
 
.
Advertisement

Keep the Community Clean!

  • StartupNation forums should be used as a platform to learn, educate others, share stories, tips & tricks and to provide constructive feedback.
  • Please do not use the Forums for advertising & blatant self-promotion.
  • Please be respectful to other members and refrain from personal attacks and vulgar language.
  • StartupNation reserves the right to delete any message, reply, and/or member who violates our terms of use.
Read full terms of use
Advertisement
Advertisement
Advertisement
Advertisement