Uses of Class
de.l3s.icrawl.crawler.CrawlUrl

Packages that use CrawlUrl

Package	Description
de.l3s.icrawl.crawler
de.l3s.icrawl.crawler.analysis	Analysis of the content of crawled Web pages.
de.l3s.icrawl.crawler.frontier	Crawler queue / frontier management
de.l3s.icrawl.crawler.io	Fetching and storing of archive snapshots

Uses of CrawlUrl in de.l3s.icrawl.crawler

Methods in de.l3s.icrawl.crawler that return CrawlUrl

Modifier and Type	Method and Description
static CrawlUrl	CrawlUrl.fromSeed(String url, float priority)
CrawlUrl	Resource.getUrl()
CrawlUrl	CrawlUrl.merge(CrawlUrl mergee) Merge with other instance.
CrawlUrl	CrawlUrl.outlink(String url, float priority, ZonedDateTime crawlTime)

Methods in de.l3s.icrawl.crawler with parameters of type CrawlUrl

Modifier and Type	Method and Description
CrawlUrl	CrawlUrl.merge(CrawlUrl mergee) Merge with other instance.

Constructors in de.l3s.icrawl.crawler with parameters of type CrawlUrl

Constructor and Description
CrawledResource(CrawlUrl url, Snapshot resource, double relevance, ZonedDateTime modifiedDate)
CrawledResource(CrawlUrl url, Snapshot resource, double relevance, ZonedDateTime modifiedDate, Duration snapshotsDuration, double minRelevance, double maxRelevance)
Resource(CrawlUrl url, Map<String,String> headers, String content)

Uses of CrawlUrl in de.l3s.icrawl.crawler.analysis

Methods in de.l3s.icrawl.crawler.analysis that return types with arguments of type CrawlUrl

Modifier and Type	Method and Description
Collection<CrawlUrl>	ResourceAnalyser.Result.getOutlinks()

Methods in de.l3s.icrawl.crawler.analysis with parameters of type CrawlUrl

Modifier and Type	Method and Description
ResourceAnalyser.Result	ResourceAnalyser.analyse(Snapshot resource, CrawlUrl url)

Uses of CrawlUrl in de.l3s.icrawl.crawler.frontier

Methods in de.l3s.icrawl.crawler.frontier that return types with arguments of type CrawlUrl

Modifier and Type	Method and Description
Optional<CrawlUrl>	Frontier.pop()
Optional<CrawlUrl>	BaseFrontier.pop()
protected Optional<CrawlUrl>	InMemoryFrontier.popInternal()
protected Optional<CrawlUrl>	FileBasedFrontier.popInternal()
protected abstract Optional<CrawlUrl>	BaseFrontier.popInternal()

Methods in de.l3s.icrawl.crawler.frontier with parameters of type CrawlUrl

Modifier and Type	Method and Description
protected void	InMemoryFrontier.pushInternal(CrawlUrl url)
protected void	FileBasedFrontier.pushInternal(CrawlUrl url)
protected abstract void	BaseFrontier.pushInternal(CrawlUrl url)

Method parameters in de.l3s.icrawl.crawler.frontier with type arguments of type CrawlUrl

Modifier and Type	Method and Description
void	Frontier.push(Collection<CrawlUrl> urls)
void	BaseFrontier.push(Collection<CrawlUrl> urls)

Uses of CrawlUrl in de.l3s.icrawl.crawler.io

Methods in de.l3s.icrawl.crawler.io with parameters of type CrawlUrl

Modifier and Type	Method and Description
List<Snapshot>	ArchiveFetcher.get(CrawlUrl url, TimeSpecification referenceTime)
void	CsvStorer.storeNotFound(CrawlUrl url)
void	ZipFileStorer.storeNotFound(CrawlUrl url)
void	LoggingStorer.storeNotFound(CrawlUrl url)
void	ResultStorer.storeNotFound(CrawlUrl url)