org.apache.hadoop.hive.ql.io.orc

Class OrcFlowFileWriter.StreamFactory

java.lang.Object

org.apache.hadoop.hive.ql.io.orc.OrcFlowFileWriter.StreamFactory

Enclosing class:

OrcFlowFileWriter

private class OrcFlowFileWriter.StreamFactory
extends Object

Interface from the Writer to the TreeWriters. This limits the visibility that the TreeWriters have into the Writer.

Constructor Summary

Constructors

Modifier	Constructor and Description
private	StreamFactory()

Method Summary

Modifier and Type	Method and Description
boolean	buildIndex() Should be building the row index.
org.apache.hadoop.hive.ql.io.orc.OutStream	createStream(int column, org.apache.hadoop.hive.ql.io.orc.OrcProto.Stream.Kind kind) Create a stream to store part of a column.
boolean[]	getBloomFilterColumns() Get the bloom filter columns
double	getBloomFilterFPP() Get bloom filter false positive percentage.
org.apache.hadoop.hive.ql.io.orc.OrcFile.CompressionStrategy	getCompressionStrategy() Get the compression strategy to use.
org.apache.hadoop.conf.Configuration	getConfiguration() Get the writer's configuration.
int	getCurrentColumnId() Get the current column id.
org.apache.hadoop.hive.ql.io.orc.OrcFile.EncodingStrategy	getEncodingStrategy() Get the encoding strategy to use.
int	getNextColumnId() Get the next column id.
int	getRowIndexStride() Get the stride rate of the row index.
org.apache.hadoop.hive.ql.io.orc.OrcFile.Version	getVersion() Get the version of the file to write.
boolean	isCompressed() Is the ORC file compressed?

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamFactory

private StreamFactory()

Method Detail

createStream

public org.apache.hadoop.hive.ql.io.orc.OutStream createStream(int column,
                                                               org.apache.hadoop.hive.ql.io.orc.OrcProto.Stream.Kind kind)
                                                        throws IOException

Create a stream to store part of a column.

Parameters:

column - the column id for the stream

kind - the kind of stream

Returns:

The output outStream that the section needs to be written to.

Throws:

IOException - if an error occurs while creating the stream

getNextColumnId

public int getNextColumnId()

Get the next column id.

Returns:

a number from 0 to the number of columns - 1

getCurrentColumnId

public int getCurrentColumnId()

Get the current column id. After creating all tree writers this count should tell how many columns (including columns within nested complex objects) are created in total.

Returns:

current column id

getRowIndexStride

public int getRowIndexStride()

Get the stride rate of the row index.

buildIndex

public boolean buildIndex()

Should be building the row index.

Returns:

true if we are building the index

isCompressed

public boolean isCompressed()

Is the ORC file compressed?

Returns:

are the streams compressed

getEncodingStrategy

public org.apache.hadoop.hive.ql.io.orc.OrcFile.EncodingStrategy getEncodingStrategy()

Get the encoding strategy to use.

Returns:

encoding strategy

getCompressionStrategy

public org.apache.hadoop.hive.ql.io.orc.OrcFile.CompressionStrategy getCompressionStrategy()

Get the compression strategy to use.

Returns:

compression strategy

getBloomFilterColumns

public boolean[] getBloomFilterColumns()

Get the bloom filter columns

Returns:

bloom filter columns

getBloomFilterFPP

public double getBloomFilterFPP()

Get bloom filter false positive percentage.

Returns:

fpp

getConfiguration

public org.apache.hadoop.conf.Configuration getConfiguration()

Get the writer's configuration.

Returns:

configuration

getVersion

public org.apache.hadoop.hive.ql.io.orc.OrcFile.Version getVersion()

Get the version of the file to write.