org.apache.hudi.io.storage

Class HoodieHFileWriter<T extends HoodieRecordPayload,R extends org.apache.avro.generic.IndexedRecord>

java.lang.Object

org.apache.hudi.io.storage.HoodieHFileWriter<T,R>

All Implemented Interfaces:

HoodieFileWriter<R>

public class HoodieHFileWriter<T extends HoodieRecordPayload,R extends org.apache.avro.generic.IndexedRecord>
extends Object
implements HoodieFileWriter<R>

HoodieHFileWriter writes IndexedRecords into an HFile. The record's key is used as the key and the AVRO encoded record bytes are saved as the value. Limitations (compared to columnar formats like Parquet or ORC): 1. Records should be added in order of keys 2. There are no column stats

Constructor Summary

Constructors

Constructor and Description
HoodieHFileWriter(String instantTime, org.apache.hadoop.fs.Path file, HoodieHFileConfig hfileConfig, org.apache.avro.Schema schema, TaskContextSupplier taskContextSupplier, boolean populateMetaFields)

Method Summary

Modifier and Type	Method and Description
boolean	canWrite()
void	close()
void	writeAvro(String recordKey, org.apache.avro.generic.IndexedRecord record)
void	writeAvroWithMetadata(HoodieKey key, R avroRecord)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.io.storage.HoodieFileWriter

prepRecordWithMetadata

Constructor Detail

HoodieHFileWriter

public HoodieHFileWriter(String instantTime,
                         org.apache.hadoop.fs.Path file,
                         HoodieHFileConfig hfileConfig,
                         org.apache.avro.Schema schema,
                         TaskContextSupplier taskContextSupplier,
                         boolean populateMetaFields)
                  throws IOException

Throws:

IOException

Method Detail

writeAvroWithMetadata

public void writeAvroWithMetadata(HoodieKey key,
                                  R avroRecord)
                           throws IOException

Specified by:

writeAvroWithMetadata in interface HoodieFileWriter<R extends org.apache.avro.generic.IndexedRecord>

Throws:

IOException

canWrite

public boolean canWrite()

Specified by:

canWrite in interface HoodieFileWriter<R extends org.apache.avro.generic.IndexedRecord>

writeAvro

public void writeAvro(String recordKey,
                      org.apache.avro.generic.IndexedRecord record)
               throws IOException

Specified by:

writeAvro in interface HoodieFileWriter<R extends org.apache.avro.generic.IndexedRecord>

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface HoodieFileWriter<R extends org.apache.avro.generic.IndexedRecord>

Throws:

IOException