Go Back   vBulletin Setup > vBulletinSetup Information > vBulletin SEO Tips and SEO Questions > Search Engine News

Why not Register and remove some of the ads from vBulletin Setup
Post New Article  Comment
The top 4 search engines now support Sitemaps auto submission
Published by News
04-21-2007
The top 4 search engines now support Sitemaps auto submission

In November 2006, Google, Yahoo and Microsoft agreed to support the Sitemap protocol. The Sitemap protocol is a standard that can help you to submit all of your web pages to search engines.
Last week, Ask.com joined the team so that now all four major search engines support the Sitemap protocol. In addition, search engines can now automatically detect your Sitemaps file.


What are sitemaps and what is the official Sitemaps protocol?
Sitemaps are an easy way for webmasters to inform search engines about pages on their sites that are available for crawling. In its simplest form, a sitemap is an XML file that lists URLs for a site along with additional metadata about each URL:
  • when it was last updated
  • how often it usually changes
  • how important it is, relative to other URLs in the site
That information helps search engines to more intelligently crawl your site. The Sitemaps news is a standard that makes it easier to create a sitemap that can be parsed by all search engines.
How can the Sitemaps protocol help your website?
Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow crawlers that support sitemaps to pick up all URLs in the sitemap and learn about those URLs using the associated metadata.
The sitemap allows you to inform search engines about the pages on your website. Depending on how your website is structured, it can be easier for search engines to find all of your web pages if you use a sitemap.
How do search engines find my Sitemaps file? What's new?
The big four search engines Google, Yahoo, Live/MSN and Ask will now automatically index your Sitemaps file if you add a link to your Sitemaps file in your robots.txt file.
All the major search engines regularly check the robots.txt of a website. Just add the following line to your robots.txt file:
Sitemap: http:/www.yoursite.com/sitemap.xml
Of course, you can also actively inform Google and Yahoo about your Sitemap file. This is not possible with Live/MSN and Ask.
Does a Sitemaps file improve your search engine rankings?
Using the Sitemap protocol does not guarantee that your web pages are included in search engines, but provides hints for web crawlers to do a better job of crawling your site.
A sitemap helps search engines to find your web pages but it does not help you to get higher search engine rankings.
When search engines index your web pages, they must find optimized web page content and good inbound links. Search engines will only give your web pages high rankings if they have both.
The Sitemaps protocol can help you to inform search engines about your web pages. Further information about the new sitemaps standard can be found on the official sitemaps web site.

[Source..]
Article Tools

  #1  
By eric on 04-21-2007, 01:21 AM
Re: The top 4 search engines now support Sitemaps auto submission

ok, I already ping Google and Yahoo, how to ping both others .. someone knows ?
Reply With Quote
  #2  
By Brandon on 04-21-2007, 03:23 PM
Re: The top 4 search engines now support Sitemaps auto submission

good question, I'm not sure
Reply With Quote
  #3  
By peterpigman on 04-22-2007, 03:47 AM
Re: The top 4 search engines now support Sitemaps auto submission

How would you write the xml file?
Reply With Quote
  #4  
By AzzidReign on 04-22-2007, 02:16 PM
Re: The top 4 search engines now support Sitemaps auto submission

Great article! The only thing I'm wondering is how to point to these sitemap files when using vBSEO. With vBSEO, you get a ton of sitemap files (if you have a large site...I'm up to around 16 sitemap files I think)...do I just add the index file...or what?
Reply With Quote
  #5  
By Brandon on 04-22-2007, 02:36 PM
Re: The top 4 search engines now support Sitemaps auto submission

Quote:
Originally Posted by AzzidReign View Post
Great article! The only thing I'm wondering is how to point to these sitemap files when using vBSEO. With vBSEO, you get a ton of sitemap files (if you have a large site...I'm up to around 16 sitemap files I think)...do I just add the index file...or what?
another good question..bummer, stumped 2 times in a row..lol

well, I don't have that large of sitemap, but I've seen questions like this at vbseo.com.. I'll have to run over and check things out and reply here later.

-Bs
Reply With Quote
  #6  
By AzzidReign on 04-22-2007, 02:45 PM
Re: The top 4 search engines now support Sitemaps auto submission

Well, if you want to, send me the link to your thread over there I like to keep tract of progress that goes on at vbseo.
Reply With Quote
  #7  
By Brandon on 04-22-2007, 03:15 PM
Re: The top 4 search engines now support Sitemaps auto submission

well I haven't made it over to look for any threads. This is the url I send to google http://forum.vbulletinsetup.com/sitemap_index.xml.gz
Reply With Quote
  #8  
By Capper on 04-23-2007, 07:20 PM
Re: The top 4 search engines now support Sitemaps auto submission

Where would i add this in my sitemap? Also, would i put a separate one for my forums and my main site?

http:/www.yoursite.com/sitemap.xml

Code:
User-agent: *
Disallow: /cowadmin/
Disallow: /archive/
Disallow: /templates/
Disallow: /dmenu/
Disallow: /tpllib/
Disallow: /data/
Disallow: /print.php
Disallow: /pdf.php
Disallow: /xml.php
Disallow: /txt.php
Disallow: /mailto.php
Disallow: /forums/ajax.php
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/inlinemod.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/member.php
Disallow: /forums/memberlist.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattachment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/showgroups.php
Disallow: /forums/subscription.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php
Reply With Quote
  #9  
By eric on 04-24-2007, 02:48 AM
Re: The top 4 search engines now support Sitemaps auto submission

this is what you have to set in robots.txt in highest level of your account

this is to tell search robots not to go in those areas. According me nothing to do with sitemap
Reply With Quote
Post New Article  Comment
vBulletin Setup > vBulletinSetup Information > vBulletin SEO Tips and SEO Questions > Search Engine News


Article Tools
Display Modes

 
Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Article Article Starter Category Comments Last Post
Are you unintentionally spamming search engines Brandon Website Marketing Articles 4 10-25-2007 02:11 PM
How to gain a good page ranking on the major search engines Greek76 Website Marketing Articles 1 11-08-2006 03:14 PM
Target visitors or search engines? Brandon Search Engine News 0 11-02-2006 09:51 PM
1. Six reasons why search engines ignore your web pages Brandon Search Engine News 1 10-15-2006 07:45 PM
Search Engine Submission Brandon Link or Banner Sales and Trades 5 10-03-2006 01:52 PM


All times are GMT -6. The time now is 08:32 AM.

vBulletin Setup, vBulletin Setup Forums, vBulletin Services, vBulletin Blogs, vBulletin SEO, vBulletin Questions, vBulletin Skins, Styles, Templates
vBulletin Hacks / Modifications, vBulletin Monetization, Blogs, vBulletin Link Directory,Quality Link Directory