Please Register to get full access to the forums.
 Supporters vBulletin Owner
#1
10-25-2007, 02:22 PM
Preventing people reading your robots.txt file? How do you stop people reading/seeing your file? For example, see this vBulletin SEO Setup robots.txt file Quote |
 vBulletin Owner
#2
10-25-2007, 02:35 PM
Re: Preventing people reading your robots.txt file? I don't think there is actually a way to do this, because the search engine bots have to read this file and if you block access they would be blocked as well.
-------------------- India Travel Forum | India Travel Directory | India Photo Gallery | Free Travel Directory Quote |
 vBSetup Team vBulletin Owner vBSetup Owner
#3
10-25-2007, 05:40 PM
Re: Preventing people reading your robots.txt file? I don't see how you could since it's just a text file.
--------------------
Brandon Sheley / vBulletin Setup Staff
Check out our Newsletter for the latest vB and SEO news. Are you looking for vBulletin work to be done on your forums ? Would you like to Help Support vBulletin Setup. Please do not PM me for support, that's what the forums are for. Have you heard about Crowdgather?Find it on Forums Stay up to date by installing our Tool Bar Quote |
 Supporters vBulletin Owner
#4
10-25-2007, 10:05 PM
Re: Preventing people reading your robots.txt file? I don't know the answer to the question, but why would you want to have it hidden in the first place? I mean people aren't actively searching for that file are they, and if they are what can people do with it to harm the forum? Quote |
vBulletin Owner
#5
10-25-2007, 10:22 PM
Re: Preventing people reading your robots.txt file? My guess, he is trying to put nofollow tag on outbound links and doesn’t wants others to know about it!
-------------------- India Travel Forum | India Travel Directory | India Photo Gallery | Free Travel Directory Quote |
Supporters vBulletin Owner
#6
10-25-2007, 10:33 PM
Re: Preventing people reading your robots.txt file? Quote:
 Quote |
vBulletin Owner
#7
10-25-2007, 10:54 PM
Re: Preventing people reading your robots.txt file?
-------------------- India Travel Forum | India Travel Directory | India Photo Gallery | Free Travel Directory Quote |
 vBulletin Owner
#8
10-26-2007, 01:00 AM
Re: Preventing people reading your robots.txt file? And knowing the general internet goer, most people don't even know what a robots.txt file is & what purpose it serves. If you attempt to restrict it, then the search engines can't read it and it completely defeats the purpose of a robots.txt file in the first place. You could attempt to limit viewing of the file to certain IP, but inevitably, you can't get all the search engines.
-------------------- Xbox Nation Quote |
Supporters vBulletin Owner
#9
10-26-2007, 02:44 AM
Re: Preventing people reading your robots.txt file? None of the above. I just dont like snoops and people who copy of you. If I'm smart enough or persistent enough to spend time finding out stuff why should it not then be kept to myself instead of being public access? When you spend a lot of time doing stuff to make your site perform better, be more secure, get high rankings then it's a shame people can just copy. That's my take on it. Quote |
 vBSetup Team Tech Admin vBulletin Owner
#10
10-26-2007, 09:08 AM
Re: Preventing people reading your robots.txt file? well 9/10 you will be using the same robots.txt if you are on a vbulletin forum, and you know about SEo ;). Sharing is caring. Just think if none of the staff here shared with you regular members.
-------------------- Do NOT PM me for Support!
Michael Biddle / vBulletin Setup Staff
Check out our Newsletter for the latest vB and SEO news. Are you looking for vBulletin work to be done on your forums ? Would you like to Help Support vBulletin Setup. Quote |
All times are GMT -6. The time now is 10:13 PM. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Linear Mode
