co.cask.cdap.logging.read

Class DistributedLogReader

java.lang.Object

co.cask.cdap.logging.read.DistributedLogReader

All Implemented Interfaces:

LogReader

public final class DistributedLogReader
extends Object
implements LogReader

Reads logs in a distributed setup, using kafka for latest logs and files for older logs.

Constructor Summary

Constructors

Constructor and Description
DistributedLogReader(KafkaLogReader kafkaLogReader, FileLogReader fileLogReader, CheckpointManagerFactory checkpointManagerFactory, StringPartitioner partitioner) Creates a DistributedLogReader object.

Method Summary

Methods

Modifier and Type	Method and Description
void	getLog(LoggingContext loggingContext, long fromTimeMs, long toTimeMs, Filter filter, Callback callback) Returns log events of a Flow or Map between given times.
void	getLogNext(LoggingContext loggingContext, ReadRange readRange, int maxEvents, Filter filter, Callback callback) Read log events of a Flow or Map Reduce program after a given offset.
void	getLogPrev(LoggingContext loggingContext, ReadRange readRange, int maxEvents, Filter filter, Callback callback) Read log events of a Flow or Map Reduce program before a given offset.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DistributedLogReader

@Inject
public DistributedLogReader(KafkaLogReader kafkaLogReader,
                           FileLogReader fileLogReader,
                           CheckpointManagerFactory checkpointManagerFactory,
                           StringPartitioner partitioner)

Creates a DistributedLogReader object.

Method Detail

getLogNext

public void getLogNext(LoggingContext loggingContext,
              ReadRange readRange,
              int maxEvents,
              Filter filter,
              Callback callback)

Description copied from interface: LogReader

Read log events of a Flow or Map Reduce program after a given offset.

Specified by:

getLogNext in interface LogReader

Parameters:

loggingContext - context to look up log events.

readRange - range for reading log events. Use ReadRange.LATEST to get the latest log events.

maxEvents - max log events to return.

filter - filter to select log events

callback - callback to handle the log events.

getLogPrev

public void getLogPrev(LoggingContext loggingContext,
              ReadRange readRange,
              int maxEvents,
              Filter filter,
              Callback callback)

Description copied from interface: LogReader

Read log events of a Flow or Map Reduce program before a given offset.

Specified by:

getLogPrev in interface LogReader

Parameters:

loggingContext - context to look up log events.

readRange - range for reading log events. Use ReadRange.LATEST to get the latest log events.

maxEvents - max log events to return.

filter - filter to select log events

callback - callback to handle the log events.

getLog

public void getLog(LoggingContext loggingContext,
          long fromTimeMs,
          long toTimeMs,
          Filter filter,
          Callback callback)

Description copied from interface: LogReader

Returns log events of a Flow or Map between given times.

Specified by:

getLog in interface LogReader

Parameters:

loggingContext - context to look up log events.

fromTimeMs - start time.

toTimeMs - end time.

filter - filter to select log events

callback - Callback to handle the log events.