close >>>

Crawler

It is a program that creates an index of online data by methodically scanning the Internet, visiting different websites, and reading through the contents of different web pages; also known as “spider”.