cn.spark2fire.jscrapy.scheduler

类 RedisPriorityScheduler

java.lang.Object

cn.spark2fire.jscrapy.scheduler.DuplicateRemovedScheduler

cn.spark2fire.jscrapy.scheduler.RedisScheduler

cn.spark2fire.jscrapy.scheduler.RedisPriorityScheduler

所有已实现的接口:

DuplicateRemover, MonitorableScheduler, Scheduler

public class RedisPriorityScheduler
extends RedisScheduler

the redis scheduler with priority

作者:

sai Created by sai on 16-5-27.

字段概要

字段

限定符和类型	字段和说明
private static String	MINUS_PRIORITY_SUFFIX
private static String	NO_PRIORITY_SUFFIX
private static String	PLUS_PRIORITY_SUFFIX
private static String	QUEUE_PREFIX
private static String	ZSET_PREFIX

从类继承的字段 cn.spark2fire.jscrapy.scheduler.RedisScheduler

pool

从类继承的字段 cn.spark2fire.jscrapy.scheduler.DuplicateRemovedScheduler

logger

构造器概要

构造器

构造器和说明
RedisPriorityScheduler(redis.clients.jedis.JedisPool pool)
RedisPriorityScheduler(String host)

方法概要

限定符和类型	方法和说明
private Request	getExtrasInItem(redis.clients.jedis.Jedis jedis, String url, Task task)
private String	getQueueNoPriorityKey(Task task)
private String	getRequest(redis.clients.jedis.Jedis jedis, Task task)
private String	getZsetMinusPriorityKey(Task task)
private String	getZsetPlusPriorityKey(Task task)
Request	poll(Task task)
protected void	pushWhenNoDuplicate(Request request, Task task)
void	resetDuplicateCheck(Task task)
private void	setExtrasInItem(redis.clients.jedis.Jedis jedis, Request request, Task task)

从类继承的方法 cn.spark2fire.jscrapy.scheduler.RedisScheduler

getItemKey, getLeftRequestsCount, getQueueKey, getSetKey, getTotalRequestsCount, isDuplicate

从类继承的方法 cn.spark2fire.jscrapy.scheduler.DuplicateRemovedScheduler

getDuplicateRemover, noNeedToRemoveDuplicate, push, setDuplicateRemover, shouldReserved

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 cn.spark2fire.jscrapy.scheduler.Scheduler

push

字段详细资料

ZSET_PREFIX

private static final String ZSET_PREFIX

另请参阅:

常量字段值

QUEUE_PREFIX

private static final String QUEUE_PREFIX

另请参阅:

常量字段值

NO_PRIORITY_SUFFIX

private static final String NO_PRIORITY_SUFFIX

另请参阅:

常量字段值

PLUS_PRIORITY_SUFFIX

private static final String PLUS_PRIORITY_SUFFIX

另请参阅:

常量字段值

MINUS_PRIORITY_SUFFIX

private static final String MINUS_PRIORITY_SUFFIX

另请参阅:

常量字段值

构造器详细资料

RedisPriorityScheduler

public RedisPriorityScheduler(String host)

RedisPriorityScheduler

public RedisPriorityScheduler(redis.clients.jedis.JedisPool pool)

方法详细资料

pushWhenNoDuplicate

protected void pushWhenNoDuplicate(Request request,
                                   Task task)

覆盖:

pushWhenNoDuplicate 在类中 RedisScheduler

poll

public Request poll(Task task)

指定者:

poll 在接口中 Scheduler

覆盖:

poll 在类中 RedisScheduler

getRequest

private String getRequest(redis.clients.jedis.Jedis jedis,
                          Task task)

resetDuplicateCheck

public void resetDuplicateCheck(Task task)

指定者:

resetDuplicateCheck 在接口中 DuplicateRemover

覆盖:

resetDuplicateCheck 在类中 RedisScheduler

getZsetPlusPriorityKey

private String getZsetPlusPriorityKey(Task task)

getQueueNoPriorityKey

private String getQueueNoPriorityKey(Task task)

getZsetMinusPriorityKey

private String getZsetMinusPriorityKey(Task task)

setExtrasInItem

private void setExtrasInItem(redis.clients.jedis.Jedis jedis,
                             Request request,
                             Task task)

getExtrasInItem

private Request getExtrasInItem(redis.clients.jedis.Jedis jedis,
                                String url,
                                Task task)