public class AiPaExecutor extends Object
| 构造器和说明 |
|---|
AiPaExecutor(AiPaWorker aiPaWorker) |
| 限定符和类型 | 方法和说明 |
|---|---|
ExecutorService |
getExecutor()
返回线程池
|
List<Future> |
getFutureList()
返回任务执行结果
|
AiPaExecutor |
setCharset(Charset charset)
重写爬虫代码则属性无效
|
AiPaExecutor |
setCookies(Map<String,String> cookies)
设置Cookies
重写爬虫代码则属性无效
|
AiPaExecutor |
setHeader(Map<String,String> header)
重写爬虫代码则属性无效
|
AiPaExecutor |
setMaxFailCount(int maxFailCount) |
AiPaExecutor |
setMethod(org.jsoup.Connection.Method method)
重写爬虫代码则属性无效
|
AiPaExecutor |
setThreads(int threads) |
AiPaExecutor |
setTimeout(int timeout)
默认超时时间为30秒(30000毫秒)。
|
AiPaExecutor |
setUserAgent(String userAgent)
自定义UA
重写爬虫代码则属性无效
|
void |
shutdown()
执行完后关闭线程池
|
void |
submit(List<String> list)
提交任务
|
void |
submit(List<String> list,
Class<? extends AiPaUtil> aiPaUtil)
提交任务
|
public AiPaExecutor(AiPaWorker aiPaWorker)
aiPaWorker - 用户必须实现的接口public void submit(List<String> list, Class<? extends AiPaUtil> aiPaUtil) throws IllegalAccessException, InstantiationException
list - aiPaUtil - 重写爬虫代码则IllegalAccessExceptionInstantiationExceptionpublic void shutdown()
public ExecutorService getExecutor()
public AiPaExecutor setThreads(int threads)
threads - 工作线程数量public AiPaExecutor setCharset(Charset charset)
charset - 网页解码格式public AiPaExecutor setMaxFailCount(int maxFailCount)
maxFailCount - 爬取失败最多尝试次数public AiPaExecutor setHeader(Map<String,String> header)
header - 请求头public AiPaExecutor setMethod(org.jsoup.Connection.Method method)
method - 请求方法public AiPaExecutor setTimeout(int timeout)
timeout - 请求超时public AiPaExecutor setUserAgent(String userAgent)
userAgent - public AiPaExecutor setCookies(Map<String,String> cookies)
cookies - Copyright © 2019. All rights reserved.