org.apache.hudi.common.table.log

Class LogReaderUtils

java.lang.Object

org.apache.hudi.common.table.log.LogReaderUtils

public class LogReaderUtils
extends Object

Utils class for performing various log file reading operations.

Constructor Summary

Constructors

Constructor and Description
LogReaderUtils()

Method Summary

Modifier and Type	Method and Description
static org.roaringbitmap.longlong.Roaring64NavigableMap	decodeRecordPositionsHeader(String content) Decodes the HoodieLogBlock.HeaderMetadataType.RECORD_POSITIONS block header into record positions.
static String	encodePositions(org.roaringbitmap.longlong.Roaring64NavigableMap positionBitmap) Encodes the Roaring64NavigableMap bitmap containing the record positions.
static String	encodePositions(Set<Long> positions) Encodes a list of record positions in long type.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LogReaderUtils

public LogReaderUtils()

Method Detail

encodePositions

public static String encodePositions(Set<Long> positions)
                              throws IOException

Encodes a list of record positions in long type.

The encoding applies the Base64 codec (Base64 in Java implementation) on the bytes generated from serializing Roaring64NavigableMap bitmap, which contains the list of record positions in long type, using the portable format.

Parameters:

positions - A list of long-typed positions.

Returns:

A string of Base64-encoded bytes (Base64 in Java implementation) generated from serializing Roaring64NavigableMap bitmap using the portable format.

Throws:

IOException - upon I/O error.

encodePositions

public static String encodePositions(org.roaringbitmap.longlong.Roaring64NavigableMap positionBitmap)
                              throws IOException

Encodes the Roaring64NavigableMap bitmap containing the record positions.

The encoding applies the Base64 codec (Base64 in Java implementation) on the bytes generated from serializing Roaring64NavigableMap bitmap using the portable format.

Parameters:

positionBitmap - Roaring64NavigableMap bitmap containing the record positions.

Returns:

A string of Base64-encoded bytes (Base64 in Java implementation) generated from serializing Roaring64NavigableMap bitmap using the portable format.

Throws:

IOException - upon I/O error.

decodeRecordPositionsHeader

public static org.roaringbitmap.longlong.Roaring64NavigableMap decodeRecordPositionsHeader(String content)
                                                                                    throws IOException

Decodes the HoodieLogBlock.HeaderMetadataType.RECORD_POSITIONS block header into record positions.

Parameters:

content - A string of Base64-encoded bytes (Base64 in Java implementation) generated from serializing Roaring64NavigableMap bitmap using the portable format.

Returns:

A Roaring64NavigableMap bitmap containing the record positions in long type.

Throws:

IOException - upon I/O error.