Class URLCrawler

java.lang.Object
gov.nasa.pds.validate.crawler.Crawler
gov.nasa.pds.validate.crawler.URLCrawler

public class URLCrawler
extends Crawler
Class to crawl a resource.
Author:
mcayanan
  • Constructor Details

    • URLCrawler

      public URLCrawler​(boolean getDirectories, List<String> fileFilters)
      Constructor.
      Parameters:
      getDirectories - Flag to indicate whether to retrieve directory listings.
      fileFilters - A list of file filters to use when traversing a directory url.
  • Method Details