Please Register to get full access to the forums.
 | |
04-21-2007, 12:38 AM
| |  | Join Date: Jan 2007 | Posts: 118 | The top 4 search engines now support Sitemaps auto submission In November 2006, Google, Yahoo and Microsoft agreed to support the Sitemap protocol. The Sitemap protocol is a standard that can help you to submit all of your web pages to search engines.
Last week, Ask.com joined the team so that now all four major search engines support the Sitemap...
-------------------- I am not real, don't pm me.. pm Brandon
By
Capper
on
04-24-2007, 05:26 AM
| | Re: The top 4 search engines now support Sitemaps auto submission Say again? Your post makes absolutely no sense to me. The above is my robots.txt file in my site root.....It keeps robots from accessing all those files listed......my question is....where would I put the the sitemap information...."http:/www.MYsite.com/sitemap.xml" in the above file? | | | | | | Re: The top 4 search engines now support Sitemaps auto submission Reading this from the original post would help: Quote:
How do search engines find my Sitemaps file? What's new?
The big four search engines Google, Yahoo, Live/MSN and Ask will now automatically index your Sitemaps file if you add a link to your Sitemaps file in your robots.txt file.
All the major search engines regularly check the robots.txt of a website. Just add the following line to your robots.txt file:
Sitemap: http:/www.yoursite.com/sitemap.xml
Of course, you can also actively inform Google and Yahoo about your Sitemap file. This is not possible with Live/MSN and Ask.
| So just put it anywhere in your robots.txt. I would put it right before the first disallow. | | |
By
Capper
on
04-27-2007, 05:57 AM
| | Re: The top 4 search engines now support Sitemaps auto submission well, I read the original post, which is why I asked the question....... Quote: |
Reading this from the original post would help:
| you'd think maybe answering questions without rudeness would make for a better experience for everyone......maybe some of us aren't quite the programming expert you are. I wasn't sure where exactly to put it. | | | | | | Re: The top 4 search engines now support Sitemaps auto submission Quote:
Originally Posted by Capper well, I read the original post, which is why I asked the question.......
you'd think maybe answering questions without rudeness would make for a better experience for everyone......maybe some of us aren't quite the programming expert you are. I wasn't sure where exactly to put it. | I'm no programming expert...I just use common sense. | | |
By
Capper
on
05-02-2007, 02:12 AM
| | Re: The top 4 search engines now support Sitemaps auto submission Common sense? Like maybe not posting when you don't have anything to add to a discussion?
People like you baffle me | | |
By
eric
on
05-02-2007, 02:32 AM
| | Re: The top 4 search engines now support Sitemaps auto submission Quote:
Originally Posted by Capper Say again? Your post makes absolutely no sense to me. The above is my robots.txt file in my site root.....It keeps robots from accessing all those files listed......my question is....where would I put the the sitemap information...."http:/www.MYsite.com/sitemap.xml" in the above file? | ok, now everybody cools down or I close the thread. We're here to help each other and not to yell, if you feel the urge, well go elsewhere.
Regarding the original question. It is clear I understood wrong.
First remark, why want to hide your sidemap to spiders ? Basically it is made for them and via via even to submit that directly to Google, Yahoo etc...
If you really want to hide it..
Disallow: /sitemap.xml
should do the trick | | |
By
Capper
on
05-02-2007, 03:08 AM
| | Re: The top 4 search engines now support Sitemaps auto submission I don't want to hide my sitemap.......that is my robots.txt file......I wanted to know exactly where to place the sitemap to make sure it ISN'T hidden. | | |
By
eric
on
05-02-2007, 03:23 AM
| | Re: The top 4 search engines now support Sitemaps auto submission in that case just don't do anything, it'll be read now
as you can see in your robots.txt there are onlyu disallow lines, clearly not allowed to read those files, if it isn't listed then it will be read.
just don't put it in the directories (lines ending with /) that are disallowed completely | | | | | | Re: The top 4 search engines now support Sitemaps auto submission I think you may have misunderstood eric: Quote:
How do search engines find my Sitemaps file? What's new?
The big four search engines Google, Yahoo, Live/MSN and Ask will now automatically index your Sitemaps file if you add a link to your Sitemaps file in your robots.txt file.
All the major search engines regularly check the robots.txt of a website. Just add the following line to your robots.txt file:
Sitemap: http:/www.yoursite.com/sitemap.xml
Of course, you can also actively inform Google and Yahoo about your Sitemap file. This is not possible with Live/MSN and Ask.
| It in fact does say to add it to your robots.txt file. Instead of putting Disallow: /whatever/, it says to put Sitemap: /whatever/. This will help the 4 big search engines to find your sitemap; even though you can submit your sitemaps automatically, this, to me, would be more sufficient because spiders ALWAYS read the robots.txt file. Quote: |
Common sense? Like maybe not posting when you don't have anything to add to a discussion?
| I do believe I did add to the discussion telling you exactly what you have to do and where to put it, yet you still are having troubles...no wonder I baffle you. | | | | | | Re: The top 4 search engines now support Sitemaps auto submission This is what I'm adding to top of my robot.txt page Code: Sitemap:http://forum.vbulletinsetup.com/sitemap_1.xml.gz I think I'll add the link to the blogs sitemap and the directories sitemap and I'll put it in all 3 robot.txt files | | |
 | | vBulletin Setup > vBulletinSetup Information > vBulletin SEO Tips and SEO Questions > Search Engine News | Article Tools | | | | Display Modes | Linear Mode | |
Posting Rules
| You may not post new threads You may not post replies You may not post attachments You may not edit your posts HTML code is Off | | | All times are GMT -6. The time now is 04:51 AM. |