An automated process that presents documents to a data extraction or parsing engine by following links on web pages. (See also Crawler)
Spider
An automated process that presents documents to a data extraction or parsing engine by following links on web pages. (See also Crawler)