org.apache.storm.hive.common

Class HiveWriter

java.lang.Object

org.apache.storm.hive.common.HiveWriter

public class HiveWriter
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HiveWriter.CommitFailure
static class	HiveWriter.ConnectFailure
static class	HiveWriter.Failure
static class	HiveWriter.TxnBatchFailure
static class	HiveWriter.TxnFailure
static class	HiveWriter.WriteFailure

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	closed

Constructor Summary

Constructors

Constructor and Description
HiveWriter(org.apache.hive.hcatalog.streaming.HiveEndPoint endPoint, int txnsPerBatch, boolean autoCreatePartitions, long callTimeout, ExecutorService callTimeoutPool, HiveMapper mapper, org.apache.hadoop.security.UserGroupInformation ugi)

Method Summary

Modifier and Type	Method and Description
void	abort() Aborts the current Txn and switches to next Txn.
void	close() Close the Transaction Batch and connection
void	flush(boolean rollToNext) Commits the current Txn.
long	getLastUsed()
void	heartBeat() Queues up a heartbeat request on the current and remaining txns using the heartbeatThdPool and returns immediately
void	setHeartBeatNeeded()
String	toString()
void	write(byte[] record) Write data

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

closed

protected boolean closed

Constructor Detail

HiveWriter

public HiveWriter(org.apache.hive.hcatalog.streaming.HiveEndPoint endPoint,
                  int txnsPerBatch,
                  boolean autoCreatePartitions,
                  long callTimeout,
                  ExecutorService callTimeoutPool,
                  HiveMapper mapper,
                  org.apache.hadoop.security.UserGroupInformation ugi)
           throws InterruptedException,
                  HiveWriter.ConnectFailure

Throws:

InterruptedException

HiveWriter.ConnectFailure

Method Detail

toString

public String toString()

Overrides:

toString in class Object

setHeartBeatNeeded

public void setHeartBeatNeeded()

write

public void write(byte[] record)
           throws HiveWriter.WriteFailure,
                  InterruptedException

Write data

Throws:

HiveWriter.WriteFailure

InterruptedException

flush

public void flush(boolean rollToNext)
           throws HiveWriter.CommitFailure,
                  HiveWriter.TxnBatchFailure,
                  HiveWriter.TxnFailure,
                  InterruptedException

Commits the current Txn. If 'rollToNext' is true, will switch to next Txn in batch or to a new TxnBatch if current Txn batch is exhausted TODO: see what to do when there are errors in each IO call stage

Throws:

HiveWriter.CommitFailure

HiveWriter.TxnBatchFailure

HiveWriter.TxnFailure

InterruptedException

heartBeat

public void heartBeat()
               throws InterruptedException

Queues up a heartbeat request on the current and remaining txns using the heartbeatThdPool and returns immediately

Throws:

InterruptedException

close

public void close()
           throws IOException,
                  InterruptedException

Close the Transaction Batch and connection

Throws:

IOException

InterruptedException

abort

public void abort()
           throws InterruptedException

Aborts the current Txn and switches to next Txn.

Throws:

InterruptedException - if could not get new Transaction Batch, or switch to next Txn

getLastUsed

public long getLastUsed()