Package gov.nasa.pds.validate.crawler
Class URLCrawler
java.lang.Object
gov.nasa.pds.validate.crawler.Crawler
gov.nasa.pds.validate.crawler.URLCrawler
public class URLCrawler extends Crawler
Class to crawl a resource.
- Author:
- mcayanan
-
Field Summary
Fields inherited from class gov.nasa.pds.validate.crawler.Crawler
directoryFilter, fileFilter, getDirectories
-
Constructor Summary
Constructors Constructor Description URLCrawler(boolean getDirectories, List<String> fileFilters)
Constructor. -
Method Summary
-
Constructor Details
-
URLCrawler
Constructor.- Parameters:
getDirectories
- Flag to indicate whether to retrieve directory listings.fileFilters
- A list of file filters to use when traversing a directory url.
-
-
Method Details
-
crawl
- Specified by:
crawl
in classCrawler
- Throws:
IOException
-