02
Nov
2009
Googlebot now crawling RSS feeds for content indexing
As announced on Google webmaster central blog, Google has confirmed its now crawling RSS feeds to discover fresh content and links.
While it has been known for sometime now within the search industry that Google actively crawls RSS feeds, Google has never officially confirmed this as part of their content discovering practice until now.
Just how much weight RSS feeds impact the indexing factors remains to be seen, but now having confirmation, webmasters and SEOs should be recommending clients to setup valid RSS feeds and making them available to Googlebot.
Here are some tips to make sure your RSS feed is setup for Googlebot crawling;
- Make sure your local RSS is not been block in robot.txt ( check this in Google webmaster tool )
- Link to your RSS feed via a standard HTML link on your website ( don’t embed your RSS URL in JS, flash or behind a singup form.
- Make sure your RSS feed is valid, while not required for Googlebot, a valid RSS feed is future proofing access for other search engines and is not hard to setup ( http://validator.w3.org/feed/ )
- Setup automatic RSS feed generators. Especially important for blogs and news websites, any new content should be automatically added to your RSS feed once it has been published. ( many blog platforms have standard plugins to achieve this )
- Keep your RSS feed clean. Try not to add additional content to your RSS feeds, such as including comments, advertisements. If you depend on ad revenue from your RSS feeds, try creating separate feeds and use robot.txt to block Google from accessing the ad-content feeds.
share this post http://bit.ly/2vdDnx | Sphinn this post
adsense5
Advertising3
apple2
backlinks3
baidu4
bing10
bing image search2
direct ad sales3
DuckDuckGo2
ethics2
facebook8
facebook marketing2
Firefox2
Google47
google adwords2
google analytics3
Google Chrome3
google mobile2
google news2
google news inclusion2
google webmaster tools2
Guest Post5
images2
image search2
Internet Explorer2
internet marketing4
Link Building6
linkbuilding5
local search engines5
microsoft4
online marketing2
php2
search engine competition3
search engines10
seo13
serps2
social media7
Social Media Marketing2
social networks3
spam3
spam filtering3
strategy6
twitter10
web analytics3
web browser2
web development3
wordpress3
writing2
Yahoo!6
Yandex3