Описание тега crawler4j
Crawler4j is an open source Java web crawler.
Crawler4j is an open source Java crawler which provides a simple interface for crawling the Web.
Reference: https://github.com/yasserg/crawler4j