 |
Crawler Definition
A program used by search engines to "crawl" the web by following links from page to page. This is how most search engines "find" the web pages that they place in their index. Also referred to as a spider or robot.
Back to SEO Glossary
|
|
 |