An automated program that crawls the internet, visits millions of web pages and gathers relevant data and other useful information in order to create entries for the index of a search engine. All of the popular search engines online have spiders, which are also called ‘bots’ or crawlers.’

Download the Internet Marketing Dictionary for free now. Hundreds of words defined!