org.apache.hudi.io.storage

Class HoodieBaseParquetWriter<R>

java.lang.Object

org.apache.parquet.hadoop.ParquetWriter<R>

org.apache.hudi.io.storage.HoodieBaseParquetWriter<R>

Type Parameters:

R - target type of the object being written into Parquet files (for ex, IndexedRecord, InternalRow)

All Implemented Interfaces:

Closeable, AutoCloseable

Direct Known Subclasses:

HoodieAvroParquetWriter

public abstract class HoodieBaseParquetWriter<R>
extends org.apache.parquet.hadoop.ParquetWriter<R>

Base class of Hudi's custom ParquetWriter implementations

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.parquet.hadoop.ParquetWriter

org.apache.parquet.hadoop.ParquetWriter.Builder<T,SELF extends org.apache.parquet.hadoop.ParquetWriter.Builder<T,SELF>>

Field Summary

Fields inherited from class org.apache.parquet.hadoop.ParquetWriter

DEFAULT_BLOCK_SIZE, DEFAULT_COMPRESSION_CODEC_NAME, DEFAULT_IS_DICTIONARY_ENABLED, DEFAULT_IS_VALIDATING_ENABLED, DEFAULT_PAGE_SIZE, DEFAULT_WRITER_VERSION, MAX_PADDING_SIZE_DEFAULT, OBJECT_MODEL_NAME_PROP

Constructor Summary

Constructors

Constructor and Description
HoodieBaseParquetWriter(org.apache.hadoop.fs.Path file, HoodieBaseParquetConfig<? extends org.apache.parquet.hadoop.api.WriteSupport<R>> parquetConfig)

Method Summary

Modifier and Type	Method and Description
boolean	canWrite()
protected long	getWrittenRecordCount()
void	write(R object)

Methods inherited from class org.apache.parquet.hadoop.ParquetWriter

close, getDataSize, getFooter

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieBaseParquetWriter

public HoodieBaseParquetWriter(org.apache.hadoop.fs.Path file,
                               HoodieBaseParquetConfig<? extends org.apache.parquet.hadoop.api.WriteSupport<R>> parquetConfig)
                        throws IOException

Throws:

IOException

Method Detail

canWrite

public boolean canWrite()

write

public void write(R object)
           throws IOException

Overrides:

write in class org.apache.parquet.hadoop.ParquetWriter<R>

Throws:

IOException

getWrittenRecordCount

protected long getWrittenRecordCount()