Go Back   vBulletin Setup > vBulletinSetup Information > vBulletin Questions


Please Register to get full access to the forums.
Post New Thread  Reply



#11   10-26-2007, 11:40 AM
Send a message via AIM to James Send a message via MSN to James James is a jewel in the rough Join Date: Mar 2007 Posts: 306 Location: Kent, WA
iTrader: (0)
Re: Preventing people reading your robots.txt file?


Yep, there is no reason to block people from reading it. Like Mike states most people who run vB are running almost the same robots.txt file.

Snooping? I am sure most of us are all running the same robots.txt file. Plus remember copying is the most sincere form of flattery.
--------------------
My Updated Blog
Quote   |  



#12   10-26-2007, 11:45 AM
noppid has a spectacular aura about Join Date: Nov 2006 Posts: 160 Location: Florida
iTrader: (0)
Re: Preventing people reading your robots.txt file?


Quote:
Originally Posted by Ekka View Post
None of the above.

I just dont like snoops and people who copy of you.

If I'm smart enough or persistent enough to spend time finding out stuff why should it not then be kept to myself instead of being public access?

When you spend a lot of time doing stuff to make your site perform better, be more secure, get high rankings then it's a shame people can just copy.

That's my take on it.
Perhaps if you explained how robots.txt can compromise you in those manners, we can suggest a solution that is better for you.

so far what you have said makes no sense at all. If you have public access content, whether it's indexed or not, people will find it. Some search engines will index you anyway despite robots.txt exclusions.

I suspect you want to hide an admin folder and noticed that to hide it from the bots after renaming you have to expose that secret folder to the public through a robots.txt entry. If so, password protect the folder with .htaccess and then who cares who knows where it is? It's no secret it exists. People will find it if they want it and are looking for it.

Do you use a tool bar? If so, there is no URL that you visit that is not exposed. They say it's not spyware and that it's necessary to know where you are to give you stats. But boy oh boy, it can be annoying when you are making a new site, you keep it private, and then find it indexed and cached under construction.

Now where did that SE get that URL? I never linked to it? They tell me don't link a site under construction and don't ask us to index an under construction, but damn, they did just that behind your back for you.

How do you make sense of such rules and procedures that undermine each other?

I'm ranting, later.
--------------------
vBPicGallery - The photo gallery for vBulletin forums.
Talk to bikers around the world about motorcycles.
Quote   |  



#13   10-26-2007, 03:04 PM
Ekka has a spectacular aura about Join Date: Aug 2007 Posts: 202 Location: Brisbane Australia
iTrader: (0)
Re: Preventing people reading your robots.txt file?


Quote:
Originally Posted by whitemike View Post
Just think if none of the staff here shared with you regular members.
Then we'd go elsewhere, and I do pay for help too!
Quote   |  



#14   10-26-2007, 03:11 PM
noppid has a spectacular aura about Join Date: Nov 2006 Posts: 160 Location: Florida
iTrader: (0)
Re: Preventing people reading your robots.txt file?


Quote:
Originally Posted by Ekka View Post
Then we'd go elsewhere, and I do pay for help too!
Cool beans! We love money!
--------------------
vBPicGallery - The photo gallery for vBulletin forums.
Talk to bikers around the world about motorcycles.
Quote   |  



#15   10-26-2007, 04:23 PM
Michael Biddle is just really niceMichael Biddle is just really nice Join Date: Aug 2006 Posts: 1,656 Location: Anaheim, CA
iTrader: (0)
Re: Preventing people reading your robots.txt file?


When was i paid?
--------------------
Do NOT PM me for Support!
Michael Biddle / vBulletin Setup Staff
Check out our Newsletter for the latest vB and SEO news.
Are you looking for vBulletin work to be done on your forums ?
Would you like to Help Support vBulletin Setup.
Quote   |  



#16   10-26-2007, 04:26 PM
Send a message via MSN to Imperial Imperial has a spectacular aura about Join Date: Jul 2007 Posts: 43 Location: California
iTrader: (0)
Re: Preventing people reading your robots.txt file?


Quote:
Originally Posted by whitemike View Post
When was i paid?
Payment only in thank yous.
--------------------
Xbox Nation
Quote   |  



#17   10-26-2007, 04:57 PM
Michael Biddle is just really niceMichael Biddle is just really nice Join Date: Aug 2006 Posts: 1,656 Location: Anaheim, CA
iTrader: (0)
Re: Preventing people reading your robots.txt file?


lol, ah ok.
--------------------
Do NOT PM me for Support!
Michael Biddle / vBulletin Setup Staff
Check out our Newsletter for the latest vB and SEO news.
Are you looking for vBulletin work to be done on your forums ?
Would you like to Help Support vBulletin Setup.
Quote   |  



#18   10-27-2007, 12:04 AM
Ekka has a spectacular aura about Join Date: Aug 2007 Posts: 202 Location: Brisbane Australia
iTrader: (0)
Re: Preventing people reading your robots.txt file?


Well, that's coz Brandon beats you to it.

Guys, I share a lot of stuff to, in fact, in the tree game I have over 200 videos that I put out there for people to learn. But I also run a business.

And to eat and live I need to get jobs. To get jobs I need to get calls etc and so goes the evolutionary path to marketing success.

Part of staying ahead of competition is doing the yards, either by yourself, via self teaching or paid help. But when you are ahead of the crowd and want to stay there it's not comforting to know people can just copy.

"what's ekka doing just copy it"

Some bits of info you give out, some you have to pay for etc. Sometimes I cannot for various reasons do what you give away so I pay ... such is life but that's the way it is for me.

I see paying for tuition as an investment. I see paying for services the same. I am a business man (small time) and tree man big time. My world is extremely competitive and anything I can do to get on top of competitors and stay there is important to me, and the less they know about what I do the better.

In fact, upon even joining here I questioned Brandon about transparency. And that it worries me people can use BS gadgets to track back to me to see where I go.

On my own forum I have a hidden area. Yes, it's very active as people dont want their business public, they want some confidence. I have asked if there is such here ... and there isn't. So many times when I post like this I feel my neck is way out there.

The robots.txt file is just another example of the transparency which is to me a negative. If it could work and be hidden is superior isn't it?
Quote   |  



#19   10-27-2007, 12:22 AM
Send a message via AIM to Brandon Send a message via MSN to Brandon Send a message via Yahoo to Brandon Brandon is a glorious beacon of lightBrandon is a glorious beacon of lightBrandon is a glorious beacon of lightBrandon is a glorious beacon of light Join Date: Jul 2006 Posts: 11,229 Location: Topeka, KS
iTrader: (0)
Sponsor our Next Contest!
Re: Preventing people reading your robots.txt file?


I don't think it can be hidden, sorry

If you are really interested in the security of your questions, and I do understand the need, we do have one hidden forum for the supporters group.
vBulletin Setup

Just thought I'd toss that out, You can get more one on one support in this group and this hidden forum.

cheers
--------------------
Brandon Sheley / vBulletin Setup Staff
Check out our Newsletter for the latest vB and SEO news.
Are you looking for vBulletin work to be done on your forums ?
Would you like to Help Support vBulletin Setup.


Add our Facebook Blog, Group and LinkedIn group.. Thanks
Stay up to date by installing our Tool Bar
Quote   |  



#20   10-28-2007, 02:06 AM
Ekka has a spectacular aura about Join Date: Aug 2007 Posts: 202 Location: Brisbane Australia
iTrader: (0)
Re: Preventing people reading your robots.txt file?


Oh beauty, I'll be in that, can you move this thread there too if I sign in?

And obviously those threads in there are not Googlarized are they.
Quote   |  
Post New Thread  Reply
vBulletin Setup > vBulletinSetup Information > vBulletin Questions


Thread Tools
Display Modes

 
Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Proof Reading & Proper Writing lazserus vBulletin SEO Tips and SEO Questions 20 11-08-2007 04:42 AM
I don't understand what to do with the PSD file Luigi vBulletin Skins, Styles and Templates 6 11-07-2007 10:26 PM
Hello people! steve7 Introduce Yourself 2 01-25-2007 01:55 AM
Can I disallow visitors from showing the threads and allow robots? THE X FILES vBulletin SEO Tips and SEO Questions 3 12-13-2006 02:25 AM
Yahoo! Search Crawler (Yahoo! Slurp) - Supporting wildcards in robots.txt Brandon Search Engine News 0 11-02-2006 10:45 PM


All times are GMT -6. The time now is 04:29 PM.

vBulletin Setup, vBulletin Setup Forums, vBulletin Services, vBulletin Blogs, vBulletin SEO, vBulletin Questions
vBulletin Skins, Styles, Templates, vBulletin Monetization, Blogs, vBulletin Link Directory,Quality Link Directory