crawlable

crawlable
Capable of being crawled.

The crawlable web made accessible by search engines does not represent the total extent of the Internet.


Wikipedia foundation.

Игры ⚽ Поможем написать реферат

Look at other dictionaries:

  • Web crawler — For the search engine of the same name, see WebCrawler. For the fictional robots called Skutters, see Red Dwarf characters#The Skutters. Not to be confused with offline reader. A Web crawler is a computer program that browses the World Wide Web… …   Wikipedia

  • MotoCMS — MotoCMS.com Developer(s) Demetrio Fortman Alex Timan Dmitriy Kuriksha Alexander Matienko Stable release 1.0 / November 2009 Operating system Cross platform Type Website creation …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”