Scrubby is the web crawler for Scrub the Web, an SEO-friendly business directory that has been operating since 1996. The bot crawls websites that have been submitted to their directory to index content and provide dofollow backlinks intended to help improve search engine rankings and visibility. The crawler supports the directory's website listing service by gathering information about submitted sites.
Search Engine Crawler
See More →