cn.spark2fire.jscrapy.pipeline

类 FilePageModelPipeline

java.lang.Object

cn.spark2fire.jscrapy.utils.FilePersistentBase

cn.spark2fire.jscrapy.pipeline.FilePageModelPipeline

所有已实现的接口:

PageModelPipeline

public class FilePageModelPipeline
extends FilePersistentBase
implements PageModelPipeline

Store results objects (page models) to files in plain format.
Use model.getKey() as file name if the model implements HasKey.
Otherwise use SHA1 as file name.

从以下版本开始:

0.3.0

作者:

code4crafter@gmail.com

字段概要

字段

限定符和类型	字段和说明
private org.slf4j.Logger	logger

从类继承的字段 cn.spark2fire.jscrapy.utils.FilePersistentBase

path, PATH_SEPERATOR

构造器概要

构造器

构造器和说明
FilePageModelPipeline() new JsonFilePageModelPipeline with default path "/data/webmagic/"
FilePageModelPipeline(String path)

方法概要

限定符和类型	方法和说明
void	process(Object o, Task task)

从类继承的方法 cn.spark2fire.jscrapy.utils.FilePersistentBase

checkAndMakeParentDirecotry, getFile, getPath, setPath

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

logger

private org.slf4j.Logger logger

构造器详细资料

FilePageModelPipeline

public FilePageModelPipeline()

new JsonFilePageModelPipeline with default path "/data/webmagic/"

FilePageModelPipeline

public FilePageModelPipeline(String path)

方法详细资料

process

public void process(Object o,
                    Task task)

指定者:

process 在接口中 PageModelPipeline