| Package | Description |
|---|---|
| de.l3s.icrawl.crawler | |
| de.l3s.icrawl.crawler.analysis |
Analysis of the content of crawled Web pages.
|
| de.l3s.icrawl.crawler.frontier |
Crawler queue / frontier management
|
| de.l3s.icrawl.crawler.io |
Fetching and storing of archive snapshots
|
| de.l3s.icrawl.crawler.yarn |
Runner classes to execute the crawler as a YARN job.
|
| Class and Description |
|---|
| ArchiveCrawler.StorerConfig |
| ArchiveCrawlSpecification |
| CrawlUrl |
| CrawlUrl.Path |
| TimeSpecification |
| Class and Description |
|---|
| ArchiveCrawlSpecification |
| CrawlUrl |
| Class and Description |
|---|
| CrawlUrl |
| Class and Description |
|---|
| CrawledResource |
| CrawlUrl |
| TimeSpecification |
| Class and Description |
|---|
| Crawler |
Copyright © 2017. All rights reserved.