Go Back   vBulletin Setup > vBulletinSetup Information > vBulletin Questions


Please Register to get full access to the forums.
Post New Thread  Reply



#1   10-25-2007, 02:22 PM
Ekka has a spectacular aura about Join Date: Aug 2007 Posts: 197 Location: Brisbane Australia
Preventing people reading your robots.txt file?


How do you stop people reading/seeing your file?

For example, see this vBulletin SEO Setup robots.txt file
Quote   |  



#2   10-25-2007, 02:35 PM
Yogesh Sarkar is just really niceYogesh Sarkar is just really nice Join Date: Feb 2007 Posts: 740 Location: New Delhi, India
Re: Preventing people reading your robots.txt file?


I don't think there is actually a way to do this, because the search engine bots have to read this file and if you block access they would be blocked as well.
Quote   |  



#3   10-25-2007, 05:40 PM
Send a message via AIM to Brandon Send a message via MSN to Brandon Send a message via Yahoo to Brandon Brandon is a glorious beacon of lightBrandon is a glorious beacon of lightBrandon is a glorious beacon of lightBrandon is a glorious beacon of light Join Date: Jul 2006 Posts: 9,839 Location: Topeka, KS
Re: Preventing people reading your robots.txt file?


I don't see how you could since it's just a text file.
--------------------
Brandon Sheley / vBulletin Setup Staff
Check out our Newsletter for the latest vB and SEO news.
Are you looking for vBulletin work to be done on your forums ?
Would you like to Help Support vBulletin Setup.

Please do not PM me for support, that's what the forums are for.
Have you heard about Crowdgather?
Find it on Forums


Stay up to date by installing our Tool Bar
Quote   |  



#4   10-25-2007, 10:05 PM
Luigi has a spectacular aura about Join Date: Oct 2007 Posts: 386
Re: Preventing people reading your robots.txt file?


I don't know the answer to the question, but why would you want to have it hidden in the first place? I mean people aren't actively searching for that file are they, and if they are what can people do with it to harm the forum?
Quote   |  



#5   10-25-2007, 10:22 PM
Yogesh Sarkar is just really niceYogesh Sarkar is just really nice Join Date: Feb 2007 Posts: 740 Location: New Delhi, India
Re: Preventing people reading your robots.txt file?


My guess, he is trying to put nofollow tag on outbound links and doesn’t wants others to know about it!
Quote   |  



#6   10-25-2007, 10:33 PM
Luigi has a spectacular aura about Join Date: Oct 2007 Posts: 386
Re: Preventing people reading your robots.txt file?


Quote:
Originally Posted by Yogesh Sarkar View Post
My guess, he is trying to put nofollow tag on outbound links and doesn’t wants others to know about it!
Sorry to change directions for a second, but what's a no follow tag? I don't follow...
Quote   |  



#7   10-25-2007, 10:54 PM
Yogesh Sarkar is just really niceYogesh Sarkar is just really nice Join Date: Feb 2007 Posts: 740 Location: New Delhi, India
Re: Preventing people reading your robots.txt file?


nofollow - Wikipedia, the free encyclopedia
Quote   |  



#8   10-26-2007, 01:00 AM
Send a message via MSN to Imperial Imperial has a spectacular aura about Join Date: Jul 2007 Posts: 41 Location: California
Re: Preventing people reading your robots.txt file?


And knowing the general internet goer, most people don't even know what a robots.txt file is & what purpose it serves. If you attempt to restrict it, then the search engines can't read it and it completely defeats the purpose of a robots.txt file in the first place. You could attempt to limit viewing of the file to certain IP, but inevitably, you can't get all the search engines.
--------------------
Xbox Nation
Quote   |  



#9   10-26-2007, 02:44 AM
Ekka has a spectacular aura about Join Date: Aug 2007 Posts: 197 Location: Brisbane Australia
Re: Preventing people reading your robots.txt file?


None of the above.

I just dont like snoops and people who copy of you.

If I'm smart enough or persistent enough to spend time finding out stuff why should it not then be kept to myself instead of being public access?

When you spend a lot of time doing stuff to make your site perform better, be more secure, get high rankings then it's a shame people can just copy.

That's my take on it.
Quote   |  



#10   10-26-2007, 09:08 AM
Michael Biddle is just really niceMichael Biddle is just really nice Join Date: Aug 2006 Posts: 1,562 Location: Anaheim, CA
Re: Preventing people reading your robots.txt file?


well 9/10 you will be using the same robots.txt if you are on a vbulletin forum, and you know about SEo ;). Sharing is caring. Just think if none of the staff here shared with you regular members.
--------------------
Do NOT PM me for Support!
Michael Biddle / vBulletin Setup Staff
Check out our Newsletter for the latest vB and SEO news.
Are you looking for vBulletin work to be done on your forums ?
Would you like to Help Support vBulletin Setup.
Quote   |  
Post New Thread  Reply
vBulletin Setup > vBulletinSetup Information > vBulletin Questions


Thread Tools
Display Modes

 
Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Proof Reading & Proper Writing lazserus vBulletin SEO Tips and SEO Questions 20 11-08-2007 03:42 AM
I don't understand what to do with the PSD file Luigi vBulletin Skins, Styles and Templates 6 11-07-2007 09:26 PM
Hello people! steve7 Introduce Yourself 2 01-25-2007 12:55 AM
Can I disallow visitors from showing the threads and allow robots? THE X FILES vBulletin SEO Tips and SEO Questions 3 12-13-2006 01:25 AM
Yahoo! Search Crawler (Yahoo! Slurp) - Supporting wildcards in robots.txt Brandon Search Engine News 0 11-02-2006 09:45 PM


All times are GMT -6. The time now is 10:13 PM.

vBulletin Setup, vBulletin Setup Forums, vBulletin Services, vBulletin Blogs, vBulletin SEO, vBulletin Questions, vBulletin Skins, Styles, Templates
vBulletin Hacks / Modifications, vBulletin Monetization, Blogs, vBulletin Link Directory,Quality Link Directory