cn.spark2fire.jscrapy.pipeline

类 MultiPagePipeline

java.lang.Object

cn.spark2fire.jscrapy.pipeline.MultiPagePipeline

所有已实现的接口:

Pipeline

public class MultiPagePipeline
extends Object
implements Pipeline

A pipeline combines the result in more than one page together.
Used for news and articles containing more than one web page.
MultiPagePipeline will store parts of object and output them when all parts are extracted.

从以下版本开始:

0.2.0

作者:

code4crafter@gmail.com

字段概要

字段

限定符和类型	字段和说明
private DoubleKeyMap<String,String,MultiPageModel>	objectMap
private DoubleKeyMap<String,String,Boolean>	pageMap

构造器概要

构造器

构造器和说明
MultiPagePipeline()

方法概要

限定符和类型	方法和说明
private void	handleObject(Iterator<Map.Entry<String,Object>> iterator)
void	process(ResultItems resultItems, Task task)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

pageMap

private DoubleKeyMap<String,String,Boolean> pageMap

objectMap

private DoubleKeyMap<String,String,MultiPageModel> objectMap

构造器详细资料

MultiPagePipeline

public MultiPagePipeline()

方法详细资料

process

public void process(ResultItems resultItems,
                    Task task)

指定者:

process 在接口中 Pipeline

handleObject

private void handleObject(Iterator<Map.Entry<String,Object>> iterator)