| Package | Description |
|---|---|
| de.jungblut.crawl |
| Modifier and Type | Class and Description |
|---|---|
class |
MultithreadedCrawler<T extends FetchResult>
Fast multithreaded crawler, will start a fixed threadpool of 32 threads each
will be fed by 10 urls at once.
|
class |
SequentialCrawler<T extends FetchResult>
Sequential crawler, mainly for debugging or development.
|
Copyright © 2016. All rights reserved.