Go Back   vBulletin Setup > vBulletinSetup Information > vBulletin SEO Tips and SEO Questions > Search Engine News

Reply 
 
LinkBack Thread Tools Display Modes
Old 05-17-2007, 07:34 PM   #1
vBulletin Owner
 
News's Avatar
 
Join Date: Jan 2007
Posts: 9,413
News will become famous soon enough
Exclamation is a spammer exploiting your sitemap files ?

A recent thread in a webmaster forum indicated that some search engine spammers might exploit the new XML sitemaps files. Has your sitemaps file been abused by spammers? Can using a sitemaps file harm your search engine rankings?
What is a sitemaps XML file?
The big search engines (Google, Yahoo, MSN and Ask) introduced the Sitemaps protocol earlier this year.
In its simplest form, a sitemap is an XML file that lists URLs for a site along with additional metadata about each URL: when it was last updated, how often it usually changes, how important it is, relative to other URLs in the site, etc.
That information helps search engines to more intelligently crawl your site. The Sitemaps news is a standard that makes it easier to create a sitemap that can be parsed by all search engines.
How can such a file harm your rankings?
Some webmasters reported problems with duplicate content after adding a sitemaps XML file to their web sites.
The content of their websites appeared on dubious websites that had nothing to do with the original sites. The content of the original websites had been duplicated on many other sites. The result was that the original sites might have received ranking penalties due to duplicate content.
What happened?
Some search engine spammers used the sitemaps XML files to easily find contents for their scraper sites.
A scraper site is a website that pulls all of its information from other websites using automated tools. The scraper software pulls different contents from other websites to create new web pages that are designed around special keywords. The scraped pages usually show AdSense ads with which the spammers hopes to make money.
The new sitemaps XML files make it very easy for scraper tools to find content rich pages. Although the original intention of the sitemaps files was to inform search engines about every single page of your web site, they can also be used to inform spam bots about your pages.
What can you do to avoid problems with your sitemaps file?
One possible solution is not to use any sitemaps file at all. In that case, scraper bots can still parse your web pages through the normal links on your web pages but that would be more difficult for them than using your sitemaps file.
Another solution is to set up a sitemaps file and delete as soon as search engines have indexed that file.
Do not use free sitemap generator tools. You don't know what they will do with your data and they might even use it to create scraper sites with your content.
Unfortunately, there's not much that you can do to stop

[Source..]
News is offline   Reply With Quote

Advertisement [Remove Advertisement]

Old 05-17-2007, 09:02 PM   #2
vBulletin Owner
 
dmiller68's Avatar
 
Join Date: Feb 2007
Location: Kirkland, Wa
Posts: 43
dmiller68 has a spectacular aura about
Re: is a spammer exploiting your sitemap files ?

yeah, site duplication has been around for a while done different ways. It makes since that the sitemap could make it easier. I can’t think of a way around it other than IP blocking. I you could get all the IPs the big three search engines and block all other requests. The key would be can we get the IPs.
__________________
rapidshare downloads
dmiller68 is offline   Reply With Quote
Old 05-17-2007, 11:46 PM   #3
vBulletin Owner
 
Join Date: Sep 2006
Posts: 6
magnaromagna will become famous soon enough
Re: is a spammer exploiting your sitemap files ?

Interesting and... bad news!
Checking the IP is a big effort (if you made an error the bot cannot spider), I see only the "manual" solution: generate the sitemap, submit to google, delete it. Re-start after 5/7 days.
__________________
rapidshare downloads
magnaromagna is offline   Reply With Quote
Old 05-18-2007, 04:46 AM   #4
Community Manager
Supporters
vBulletin Owner
vBSetup Mods
 
Brandon Sheley's Avatar
 
Join Date: Jul 2006
Location: Topeka, KS
Posts: 14,110
Blog Entries: 35
Brandon Sheley is a splendid one to beholdBrandon Sheley is a splendid one to beholdBrandon Sheley is a splendid one to beholdBrandon Sheley is a splendid one to beholdBrandon Sheley is a splendid one to beholdBrandon Sheley is a splendid one to behold
Send a message via AIM to Brandon Sheley Send a message via MSN to Brandon Sheley Send a message via Yahoo to Brandon Sheley
Re: is a spammer exploiting your sitemap files ?

Quote:
Originally Posted by magnaromagna View Post
Interesting and... bad news!
Checking the IP is a big effort (if you made an error the bot cannot spider), I see only the "manual" solution: generate the sitemap, submit to google, delete it. Re-start after 5/7 days.
I've thought about that, but I just hate to do all that work
__________________
Brandon Sheley / vBulletinSetup Staff
Check the Newsletter & Marketplace for the latest deals.
Looking for a place to Support vBulletinSetup?
Submit your Forum and other Quality Websites.
Confirm your vBulletinSetup account / Read the-> Forum Rules
Are you on Twitter? @BrandonSheley I'm offering a few vBulletin Services & here is my General Forums experiment | Google fiber project

Brandon Sheley is offline   Reply With Quote
Old 05-21-2007, 01:03 PM   #5
entrepreneur
 
Join Date: Apr 2007
Posts: 1
joopss will become famous soon enough
Send a message via MSN to joopss
Re: is a spammer exploiting your sitemap files ?

Tenksssssss ............
joopss is offline   Reply With Quote
Reply 
vBulletin Setup > vBulletinSetup Information > vBulletin SEO Tips and SEO Questions > Search Engine News

Tags
exploiting, files, sitemap, spammer

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
deleting the visitor messages a spammer left Soliloquy Troubleshooting vBulletin Problems 3 07-01-2009 08:49 AM
If a spammer fails to spam, is he really a spammer? Soliloquy Community Forum Management 21 09-15-2008 08:16 AM
Spammer using PM system to spam Rocket 442 Troubleshooting vBulletin Problems 17 03-07-2008 10:43 AM
Spammer complaining that she can’t access forum Yogesh Sarkar General Discussion 2 12-29-2007 08:21 AM
Hackers Exploiting IE7 Flaw Through Google Sponsored Links Brandon Sheley General Discussion 6 04-29-2007 04:35 PM


All times are GMT -8. The time now is 12:45 AM.