cn.spark2fire.jscrapy.model

类 PageModelExtractor

java.lang.Object

cn.spark2fire.jscrapy.model.PageModelExtractor

class PageModelExtractor
extends Object

The main internal logic of page model extractor.

从以下版本开始:

0.2.0

作者:

code4crafter@gmail.com

字段概要

字段

限定符和类型	字段和说明
private Class	clazz
private List<FieldExtractor>	fieldExtractors
private List<Pattern>	helpUrlPatterns
private Selector	helpUrlRegionSelector
private org.slf4j.Logger	logger
private Extractor	objectExtractor
private List<Pattern>	targetUrlPatterns
private Selector	targetUrlRegionSelector

构造器概要

构造器

构造器和说明
PageModelExtractor()

方法概要

限定符和类型	方法和说明
private List<Object>	convert(List<String> values, ObjectFormatter objectFormatter)
private Object	convert(String value, ObjectFormatter objectFormatter)
static PageModelExtractor	create(Class clazz)
private FieldExtractor	getAnnotationExtractBy(Class clazz, Field field)
private FieldExtractor	getAnnotationExtractByUrl(Class clazz, Field field)
private FieldExtractor	getAnnotationExtractCombo(Class clazz, Field field)
(专用程序包) Class	getClazz()
(专用程序包) List<Pattern>	getHelpUrlPatterns()
(专用程序包) Selector	getHelpUrlRegionSelector()
static Method	getSetterMethod(Class clazz, Field field)
(专用程序包) List<Pattern>	getTargetUrlPatterns()
(专用程序包) Selector	getTargetUrlRegionSelector()
private void	init(Class clazz)
private void	initClassExtractors()
Object	process(Page page)
private Object	processSingle(Page page, String html, boolean isRaw)
private void	setField(Object o, FieldExtractor fieldExtractor, Object value)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

targetUrlPatterns

private List<Pattern> targetUrlPatterns

targetUrlRegionSelector

private Selector targetUrlRegionSelector

helpUrlPatterns

private List<Pattern> helpUrlPatterns

helpUrlRegionSelector

private Selector helpUrlRegionSelector

clazz

private Class clazz

fieldExtractors

private List<FieldExtractor> fieldExtractors

objectExtractor

private Extractor objectExtractor

logger

private org.slf4j.Logger logger

构造器详细资料

PageModelExtractor

PageModelExtractor()

方法详细资料

create

public static PageModelExtractor create(Class clazz)

init

private void init(Class clazz)

getAnnotationExtractByUrl

private FieldExtractor getAnnotationExtractByUrl(Class clazz,
                                                 Field field)

getAnnotationExtractCombo

private FieldExtractor getAnnotationExtractCombo(Class clazz,
                                                 Field field)

getAnnotationExtractBy

private FieldExtractor getAnnotationExtractBy(Class clazz,
                                              Field field)

getSetterMethod

public static Method getSetterMethod(Class clazz,
                                     Field field)

initClassExtractors

private void initClassExtractors()

process

public Object process(Page page)

processSingle

private Object processSingle(Page page,
                             String html,
                             boolean isRaw)

convert

private Object convert(String value,
                       ObjectFormatter objectFormatter)

convert

private List<Object> convert(List<String> values,
                             ObjectFormatter objectFormatter)

setField

private void setField(Object o,
                      FieldExtractor fieldExtractor,
                      Object value)
               throws IllegalAccessException,
                      InvocationTargetException

抛出:

IllegalAccessException

InvocationTargetException

getClazz

Class getClazz()

getTargetUrlPatterns

List<Pattern> getTargetUrlPatterns()

getHelpUrlPatterns

List<Pattern> getHelpUrlPatterns()

getTargetUrlRegionSelector

Selector getTargetUrlRegionSelector()

getHelpUrlRegionSelector

Selector getHelpUrlRegionSelector()