org.apache.hudi.avro

Class HoodieBloomFilterWriteSupport<T extends Comparable<T>>

java.lang.Object

org.apache.hudi.avro.HoodieBloomFilterWriteSupport<T>

Type Parameters:

T - record-key type being ingested by this clas

public abstract class HoodieBloomFilterWriteSupport<T extends Comparable<T>>
extends Object

This is write-support utility base-class taking up handling of

• Adding record keys to the Bloom Filter
• Keeping track of min/max record key (w/in single file)

Field Summary

Fields

Modifier and Type	Field and Description
static String	HOODIE_AVRO_BLOOM_FILTER_METADATA_KEY
static String	HOODIE_BLOOM_FILTER_TYPE_CODE
static String	HOODIE_MAX_RECORD_KEY_FOOTER
static String	HOODIE_MIN_RECORD_KEY_FOOTER
static String	OLD_HOODIE_AVRO_BLOOM_FILTER_METADATA_KEY

Constructor Summary

Constructors

Constructor and Description
HoodieBloomFilterWriteSupport(BloomFilter bloomFilter)

Method Summary

Modifier and Type	Method and Description
void	addKey(T recordKey)
protected T	dereference(T key) This method allows to dereference the key object (t/h cloning, for ex) that might be pointing at a shared mutable buffer, to make sure that we're not keeping references to mutable objects
Map<String,String>	finalizeMetadata()
protected abstract byte[]	getUTF8Bytes(T key) Since Bloom Filter ingests record-keys represented as UTF8 encoded byte string, this method have to be implemented for converting the original record key into one

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HOODIE_MIN_RECORD_KEY_FOOTER

public static final String HOODIE_MIN_RECORD_KEY_FOOTER

See Also:

Constant Field Values

HOODIE_MAX_RECORD_KEY_FOOTER

public static final String HOODIE_MAX_RECORD_KEY_FOOTER

See Also:

Constant Field Values

HOODIE_BLOOM_FILTER_TYPE_CODE

public static final String HOODIE_BLOOM_FILTER_TYPE_CODE

See Also:

Constant Field Values

HOODIE_AVRO_BLOOM_FILTER_METADATA_KEY

public static final String HOODIE_AVRO_BLOOM_FILTER_METADATA_KEY

See Also:

Constant Field Values

OLD_HOODIE_AVRO_BLOOM_FILTER_METADATA_KEY

public static final String OLD_HOODIE_AVRO_BLOOM_FILTER_METADATA_KEY

See Also:

Constant Field Values

Constructor Detail

HoodieBloomFilterWriteSupport

public HoodieBloomFilterWriteSupport(BloomFilter bloomFilter)

Method Detail

addKey

public void addKey(T recordKey)

finalizeMetadata

public Map<String,String> finalizeMetadata()

getUTF8Bytes

protected abstract byte[] getUTF8Bytes(T key)

Since Bloom Filter ingests record-keys represented as UTF8 encoded byte string, this method have to be implemented for converting the original record key into one

dereference

protected T dereference(T key)

This method allows to dereference the key object (t/h cloning, for ex) that might be pointing at a shared mutable buffer, to make sure that we're not keeping references to mutable objects