Class URLCrawler
java.lang.Object
gov.nasa.pds.tools.validate.crawler.Crawler
gov.nasa.pds.tools.validate.crawler.URLCrawler
public class URLCrawler extends Crawler
Class to crawl a resource.
- Author:
- mcayanan
-
Field Summary
Fields inherited from class gov.nasa.pds.tools.validate.crawler.Crawler
directoryFilter, fileFilter, ignoreList
-
Constructor Summary
Constructors Constructor Description URLCrawler()
-
Method Summary
Methods inherited from class gov.nasa.pds.tools.validate.crawler.Crawler
addAllIgnoreItems, crawl, crawl, crawl, crawl, setFileFilter, setFileFilter
-
Constructor Details
-
URLCrawler
public URLCrawler()
-
-
Method Details
-
crawl
public List<Target> crawl(URL url, boolean getDirectories, org.apache.commons.io.filefilter.IOFileFilter fileFilter) throws IOException- Specified by:
crawl
in classCrawler
- Throws:
IOException
-