Go Back   vBulletin Setup > vBulletinSetup Information > vBulletin SEO Tips and SEO Questions > Search Engine News


Please Register to get full access to the forums.
Post New Article  Comment



04-21-2007, 12:38 AM
News will become famous soon enough Join Date: Jan 2007 Posts: 118
The top 4 search engines now support Sitemaps auto submission


In November 2006, Google, Yahoo and Microsoft agreed to support the Sitemap protocol. The Sitemap protocol is a standard that can help you to submit all of your web pages to search engines.
Last week, Ask.com joined the team so that now all four major search engines support the Sitemap...
--------------------
I am not real, don't pm me.. pm Brandon
Quote   |  
  #10  
By Capper on 04-24-2007, 05:26 AM
Re: The top 4 search engines now support Sitemaps auto submission

Say again? Your post makes absolutely no sense to me. The above is my robots.txt file in my site root.....It keeps robots from accessing all those files listed......my question is....where would I put the the sitemap information...."http:/www.MYsite.com/sitemap.xml" in the above file?
Reply With Quote
  #11  
By AzzidReign on 04-24-2007, 08:27 AM
Re: The top 4 search engines now support Sitemaps auto submission

Reading this from the original post would help:
Quote:
How do search engines find my Sitemaps file? What's new?
The big four search engines Google, Yahoo, Live/MSN and Ask will now automatically index your Sitemaps file if you add a link to your Sitemaps file in your robots.txt file.
All the major search engines regularly check the robots.txt of a website. Just add the following line to your robots.txt file:
Sitemap: http:/www.yoursite.com/sitemap.xml
Of course, you can also actively inform Google and Yahoo about your Sitemap file. This is not possible with Live/MSN and Ask.
So just put it anywhere in your robots.txt. I would put it right before the first disallow.
Reply With Quote
  #12  
By Capper on 04-27-2007, 05:57 AM
Re: The top 4 search engines now support Sitemaps auto submission

well, I read the original post, which is why I asked the question.......

Quote:
Reading this from the original post would help:
you'd think maybe answering questions without rudeness would make for a better experience for everyone......maybe some of us aren't quite the programming expert you are. I wasn't sure where exactly to put it.
Reply With Quote
  #13  
By AzzidReign on 04-28-2007, 12:51 PM
Re: The top 4 search engines now support Sitemaps auto submission

Quote:
Originally Posted by Capper View Post
well, I read the original post, which is why I asked the question.......



you'd think maybe answering questions without rudeness would make for a better experience for everyone......maybe some of us aren't quite the programming expert you are. I wasn't sure where exactly to put it.
I'm no programming expert...I just use common sense.
Reply With Quote
  #14  
By Capper on 05-02-2007, 02:12 AM
Re: The top 4 search engines now support Sitemaps auto submission

Common sense? Like maybe not posting when you don't have anything to add to a discussion?

People like you baffle me
Reply With Quote
  #15  
By eric on 05-02-2007, 02:32 AM
Re: The top 4 search engines now support Sitemaps auto submission

Quote:
Originally Posted by Capper View Post
Say again? Your post makes absolutely no sense to me. The above is my robots.txt file in my site root.....It keeps robots from accessing all those files listed......my question is....where would I put the the sitemap information...."http:/www.MYsite.com/sitemap.xml" in the above file?
ok, now everybody cools down or I close the thread. We're here to help each other and not to yell, if you feel the urge, well go elsewhere.

Regarding the original question. It is clear I understood wrong.

First remark, why want to hide your sidemap to spiders ? Basically it is made for them and via via even to submit that directly to Google, Yahoo etc...

If you really want to hide it..


Disallow: /sitemap.xml

should do the trick
Reply With Quote
  #16  
By Capper on 05-02-2007, 03:08 AM
Re: The top 4 search engines now support Sitemaps auto submission

I don't want to hide my sitemap.......that is my robots.txt file......I wanted to know exactly where to place the sitemap to make sure it ISN'T hidden.
Reply With Quote
  #17  
By eric on 05-02-2007, 03:23 AM
Re: The top 4 search engines now support Sitemaps auto submission

in that case just don't do anything, it'll be read now
as you can see in your robots.txt there are onlyu disallow lines, clearly not allowed to read those files, if it isn't listed then it will be read.

just don't put it in the directories (lines ending with /) that are disallowed completely
Reply With Quote
  #18  
By AzzidReign on 05-02-2007, 10:00 AM
Re: The top 4 search engines now support Sitemaps auto submission

I think you may have misunderstood eric:

Quote:
How do search engines find my Sitemaps file? What's new?

The big four search engines Google, Yahoo, Live/MSN and Ask will now automatically index your Sitemaps file if you add a link to your Sitemaps file in your robots.txt file.
All the major search engines regularly check the robots.txt of a website. Just add the following line to your robots.txt file:
Sitemap: http:/www.yoursite.com/sitemap.xml
Of course, you can also actively inform Google and Yahoo about your Sitemap file. This is not possible with Live/MSN and Ask.
It in fact does say to add it to your robots.txt file. Instead of putting Disallow: /whatever/, it says to put Sitemap: /whatever/. This will help the 4 big search engines to find your sitemap; even though you can submit your sitemaps automatically, this, to me, would be more sufficient because spiders ALWAYS read the robots.txt file.

Quote:
Common sense? Like maybe not posting when you don't have anything to add to a discussion?
I do believe I did add to the discussion telling you exactly what you have to do and where to put it, yet you still are having troubles...no wonder I baffle you.
Reply With Quote
  #19  
By Brandon on 05-10-2007, 04:07 PM
Re: The top 4 search engines now support Sitemaps auto submission

This is what I'm adding to top of my robot.txt page

Code:
Sitemap:http://forum.vbulletinsetup.com/sitemap_1.xml.gz
I think I'll add the link to the blogs sitemap and the directories sitemap and I'll put it in all 3 robot.txt files
Reply With Quote
Post New Article  Comment
vBulletin Setup > vBulletinSetup Information > vBulletin SEO Tips and SEO Questions > Search Engine News


Article Tools
Display Modes

 
Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Article Article Starter Category Comments Last Post
Are you unintentionally spamming search engines Brandon Website Marketing Articles 4 10-25-2007 02:11 PM
How to gain a good page ranking on the major search engines Greek76 Website Marketing Articles 1 11-08-2006 03:14 PM
Target visitors or search engines? Brandon Search Engine News 0 11-02-2006 09:51 PM
1. Six reasons why search engines ignore your web pages Brandon Search Engine News 1 10-15-2006 07:45 PM
Search Engine Submission Brandon Link or Banner Sales and Trades 5 10-03-2006 01:52 PM


All times are GMT -6. The time now is 04:51 AM.

vBulletin Setup, vBulletin Setup Forums, vBulletin Services, vBulletin Blogs, vBulletin SEO, vBulletin Questions, vBulletin Skins, Styles, Templates
vBulletin Hacks / Modifications, vBulletin Monetization, Blogs, vBulletin Link Directory,Quality Link Directory