org.apache.hudi.common.table.log

Class HoodieLogFormatWriter

java.lang.Object

org.apache.hudi.common.table.log.HoodieLogFormatWriter

All Implemented Interfaces:

Closeable, AutoCloseable, HoodieLogFormat.Writer

public class HoodieLogFormatWriter
extends Object
implements HoodieLogFormat.Writer

HoodieLogFormatWriter can be used to append blocks to a log file Use HoodieLogFormat.WriterBuilder to construct.

Constructor Summary

Constructors

Constructor and Description
HoodieLogFormatWriter(HoodieStorage storage, HoodieLogFile logFile, Integer bufferSize, Short replication, Long sizeThreshold, String rolloverLogWriteToken, LogFileCreationCallback fileCreationHook)

Method Summary

Modifier and Type	Method and Description
AppendResult	appendBlock(HoodieLogBlock block)
AppendResult	appendBlocks(List<HoodieLogBlock> blocks)
void	close()
long	getCurrentSize()
HoodieLogFile	getLogFile()
long	getSizeThreshold()
void	withOutputStream(org.apache.hadoop.fs.FSDataOutputStream output) Overrides the output stream, only for test purpose.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieLogFormatWriter

public HoodieLogFormatWriter(HoodieStorage storage,
                             HoodieLogFile logFile,
                             Integer bufferSize,
                             Short replication,
                             Long sizeThreshold,
                             String rolloverLogWriteToken,
                             LogFileCreationCallback fileCreationHook)

Method Detail

getLogFile

public HoodieLogFile getLogFile()

Specified by:

getLogFile in interface HoodieLogFormat.Writer

getSizeThreshold

public long getSizeThreshold()

withOutputStream

public void withOutputStream(org.apache.hadoop.fs.FSDataOutputStream output)

Overrides the output stream, only for test purpose.

appendBlock

public AppendResult appendBlock(HoodieLogBlock block)
                         throws IOException,
                                InterruptedException

Specified by:

appendBlock in interface HoodieLogFormat.Writer

Throws:

IOException

InterruptedException

appendBlocks

public AppendResult appendBlocks(List<HoodieLogBlock> blocks)
                          throws IOException

Specified by:

appendBlocks in interface HoodieLogFormat.Writer

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

getCurrentSize

public long getCurrentSize()
                    throws IOException

Specified by:

getCurrentSize in interface HoodieLogFormat.Writer

Throws:

IOException