co.cask.cdap.logging.save

Interface KafkaLogProcessor

All Known Implementing Classes:

AbstractKafkaLogProcessor, KafkaLogWriterPlugin, LogMetricsPlugin

public interface KafkaLogProcessor

Process KafkaLogEvent with KafkaLogProcessor. init and stop are lifecycle methods that can be called multiple times when kafka leader partitions change.

Method Summary

Methods

Modifier and Type	Method and Description
Checkpoint	getCheckpoint(int partition) Get the checkpoint offset for a given partition.
void	init(Set<Integer> partitions) Called when the leader partitions change.
void	process(KafkaLogEvent event) Process method will be called for each event received from Kafka from the topics published for log saver.
void	stop() Called to stop processing for the current set of kafka partitions.

Method Detail

init

void init(Set<Integer> partitions)

Called when the leader partitions change.

Parameters:

partitions - new leader partitions.

process

void process(KafkaLogEvent event)

Process method will be called for each event received from Kafka from the topics published for log saver.

Parameters:

event - instance of KafkaLogEvent

stop

void stop()

Called to stop processing for the current set of kafka partitions. Stop can be called before init.

getCheckpoint

Checkpoint getCheckpoint(int partition)

Get the checkpoint offset for a given partition. This will be used to figure out the lowest offset to read from for any given partition across multiple plugins. If the plugin doesn't care about check pointing offset the implementations can just return -1;

Parameters:

partition - partition number in kafka

Returns:

checkpoint offset