public class HcDownloader extends Object implements SeimiDownloader
| 构造器和说明 |
|---|
HcDownloader(CrawlerModel crawlerModel) |
| 限定符和类型 | 方法和说明 |
|---|---|
void |
addCookies(String url,
List<SeimiCookie> seimiCookies)
添加自定义cookies
|
Response |
metaRefresh(String nextUrl)
处理meta标签refresh场景
|
Response |
process(Request request)
处理抓取请求生成response
|
int |
statusCode()
http请求状态
|
public HcDownloader(CrawlerModel crawlerModel)
public Response process(Request request) throws Exception
SeimiDownloaderprocess 在接口中 SeimiDownloaderExceptionpublic Response metaRefresh(String nextUrl) throws Exception
SeimiDownloadermetaRefresh 在接口中 SeimiDownloadernextUrl - 重定向URLExceptionpublic int statusCode()
SeimiDownloaderstatusCode 在接口中 SeimiDownloaderpublic void addCookies(String url, List<SeimiCookie> seimiCookies)
SeimiDownloaderaddCookies 在接口中 SeimiDownloaderurl - 目标地址seimiCookies - cookiesCopyright © 2017. All Rights Reserved.