org.apache.hadoop.hive.ql.io.orc

Class OrcFlowFileWriter.BufferedStream

java.lang.Object

org.apache.hadoop.hive.ql.io.orc.OrcFlowFileWriter.BufferedStream

Enclosing class:

OrcFlowFileWriter

private class OrcFlowFileWriter.BufferedStream
extends Object

This class is used to hold the contents of streams as they are buffered. The TreeWriters write to the outStream and the codec compresses the data as buffers fill up and stores them in the output list. When the stripe is being written, the whole stream is written to the file.

Field Summary

Fields

Modifier and Type	Field and Description
private List<ByteBuffer>	output
private org.apache.hadoop.hive.ql.io.orc.OutStream	outStream

Constructor Summary

Constructors

Constructor and Description
BufferedStream(String name, int bufferSize, org.apache.hadoop.hive.ql.io.orc.CompressionCodec codec)

Method Summary

Modifier and Type	Method and Description
void	clear() Clear all of the buffers.
void	flush() Flush the stream to the codec.
long	getBufferSize() Get the number of bytes in buffers that are allocated to this stream.
long	getOutputSize() Get the number of bytes that will be written to the output.
boolean	isSuppressed() Check the state of suppress flag in output stream
void	output(ByteBuffer buffer) Receive a buffer from the compression codec.
(package private) void	spillTo(OutputStream out) Write the saved compressed buffers to the OutputStream.
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

outStream

private final org.apache.hadoop.hive.ql.io.orc.OutStream outStream

output

private final List<ByteBuffer> output

Constructor Detail

BufferedStream

BufferedStream(String name,
               int bufferSize,
               org.apache.hadoop.hive.ql.io.orc.CompressionCodec codec)
        throws IOException

Throws:

IOException

Method Detail

output

public void output(ByteBuffer buffer)

Receive a buffer from the compression codec.

Parameters:

buffer - the buffer to save

Throws:

IOException - if an error occurs while receiving a buffer

getBufferSize

public long getBufferSize()

Get the number of bytes in buffers that are allocated to this stream.

Returns:

number of bytes in buffers

flush

public void flush()
           throws IOException

Flush the stream to the codec.

Throws:

IOException - if an error occurs while flushing the stream

clear

public void clear()
           throws IOException

Clear all of the buffers.

Throws:

IOException - if an error occurs while clearing the buffers

isSuppressed

public boolean isSuppressed()

Check the state of suppress flag in output stream

Returns:

value of suppress flag

getOutputSize

public long getOutputSize()

Get the number of bytes that will be written to the output. Assumes the stream has already been flushed.

Returns:

the number of bytes

spillTo

void spillTo(OutputStream out)
      throws IOException

Write the saved compressed buffers to the OutputStream.

Parameters:

out - the stream to write to

Throws:

IOException - if an error occurs during write

toString

public String toString()

Overrides:

toString in class Object