| Package | Description |
|---|---|
| de.l3s.icrawl.crawler | |
| de.l3s.icrawl.crawler.analysis |
Analysis of the content of crawled Web pages.
|
| Modifier and Type | Method and Description |
|---|---|
static ArchiveCrawlSpecification |
ArchiveCrawlSpecification.readFile(File specFile) |
ArchiveCrawlSpecification |
ArchiveCrawlSpecification.withSeedUrls(List<String> newSeedUrls) |
| Modifier and Type | Method and Description |
|---|---|
Optional<ArchiveCrawlSpecification> |
Crawler.getCurrentSpec() |
| Modifier and Type | Method and Description |
|---|---|
void |
Crawler.crawlContinuously(ArchiveCrawlSpecification spec,
StoppingCriterion stoppingCriterion,
ResourceAnalyser.WeightingMethod method,
double relevanceThreshold,
int snapshotsToAnalyze) |
| Constructor and Description |
|---|
CrawlerThread(Frontier frontier,
ArchiveFetcher fetcher,
ResultStorer storer,
ResourceAnalyser analyser,
com.codahale.metrics.MetricRegistry metrics,
ArchiveCrawlSpecification spec,
CountDownLatch barrier,
StoppingCriterion stoppingCriterion,
double relevanceThreshold) |
| Modifier and Type | Method and Description |
|---|---|
ResourceAnalyser |
ResourceAnalyserFactory.get(ArchiveCrawlSpecification spec,
ResourceAnalyser.WeightingMethod method) |
ResourceAnalyser |
ResourceAnalyser.Factory.get(ArchiveCrawlSpecification spec,
ResourceAnalyser.WeightingMethod method) |
| Constructor and Description |
|---|
ResourceAnalyser(ArchiveCrawlSpecification spec,
ResourceAnalyser.WeightingMethod method,
com.codahale.metrics.MetricRegistry metrics,
float timeRelevanceThreshold,
float docSimilarityWeight) |
Copyright © 2017. All rights reserved.