co.cask.cdap.logging.save

Class CheckpointingLogFileWriter

java.lang.Object

co.cask.cdap.logging.save.CheckpointingLogFileWriter

All Implemented Interfaces:

LogFileWriter<KafkaLogEvent>, Closeable, Flushable, AutoCloseable

public class CheckpointingLogFileWriter
extends Object
implements LogFileWriter<KafkaLogEvent>

LogFileWriter that checkpoints kafka offsets for each partition.

Constructor Summary

Constructors

Constructor and Description
CheckpointingLogFileWriter(AvroFileWriter avroFileWriter, CheckpointManager checkpointManager, long flushIntervalMs)

Method Summary

Methods

Modifier and Type	Method and Description
void	append(List<KafkaLogEvent> events) Appends a log event to an appropriate Avro file based on LoggingContext.
void	close()
void	flush()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CheckpointingLogFileWriter

public CheckpointingLogFileWriter(AvroFileWriter avroFileWriter,
                          CheckpointManager checkpointManager,
                          long flushIntervalMs)

Method Detail

append

public void append(List<KafkaLogEvent> events)
            throws Exception

Description copied from interface: LogFileWriter

Appends a log event to an appropriate Avro file based on LoggingContext. If the log event does not contain LoggingContext then the event will be dropped.

Specified by:

append in interface LogFileWriter<KafkaLogEvent>

Parameters:

events - Log event

Throws:

IOException

Exception

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

flush

public void flush()
           throws IOException

Specified by:

flush in interface Flushable

Throws:

IOException