You ask what a web crawler When accessing web pages from siteYour?  There is one tool Online that help you see web pages, from the point of view of the most famous crawlers With (Googlebot, Alexa, AskJeeves, Google-Adsense, MSN, Yahoo-Slurp, etc.) 
It is especially useful by those who create web sites. I can understand how to optimize CMS (Content Management System), in order to provide as much relevant information to SE.
smart-it-consulting.com – View a Web Page as ‘Googlebot’
With this tool you will see in the web pages and scripts JS (Java script). You have to know that the web crawlers do not execute these scripts and ignore them, so it is not recommended for anyone, to use on a website in JS.
More details, find at: smart-it-consulting.com.
P.S. BTW, of previous posts, with WP exploit. Select Crawler ”Googlebot-2.1"And write an URL of your site on the page that will open, you will see at the bottom the source of the web page and you can check it, whether it is virus or not.
Example:
URL: http://blog.dotcommerce.ro/….-premiilor-e-commerce-2006/

The action of the virus in the source of the web page. Red border.

P.S.2. itex.ro, you have BLOG virus. "… HR recruitment and consulting services in the IT field&C ... "Yes, yes! You need it! :))
 
			