Class URLCrawler


  • public class URLCrawler
    extends Crawler
    Class to crawl a resource.
    Author:
    mcayanan
    • Constructor Detail

      • URLCrawler

        public URLCrawler​(boolean getDirectories,
                          List<String> fileFilters)
        Constructor.
        Parameters:
        getDirectories - Flag to indicate whether to retrieve directory listings.
        fileFilters - A list of file filters to use when traversing a directory url.