Yahoo соревнуется в изобретательности с Гуглом:
Yahoo:
Web pages often include headers, footers, navigational sections, repeated boilerplate text, copyright notices, ad sections, or dynamic content that is useful to users — but not to search engines. Webmasters can apply the "robots-nocontent" attribute to indicate to search engines any content that is extraneous to the main unique content of the page. Yahoo! Search observes the class="robots-nocontent" present on XHTML elements, such as div, span, and all others.
http://help.yahoo.com/help/us/ysearch/slurp/slurp-14.html
Google:
Specifying the Sitemap location in your robots.txt file
You can specify the location of the Sitemap using a robots.txt file. To do this, simply add the following line:
Sitemap: sitemap_location
Комментариев нет:
Отправить комментарий