de.codepfleger.flume.parquet.sink

Class HDFSParquetSink

java.lang.Object

org.apache.flume.sink.AbstractSink

de.codepfleger.flume.parquet.sink.HDFSParquetSink

All Implemented Interfaces:

org.apache.flume.conf.Configurable, org.apache.flume.lifecycle.LifecycleAware, org.apache.flume.NamedComponent, org.apache.flume.Sink

public class HDFSParquetSink
extends org.apache.flume.sink.AbstractSink
implements org.apache.flume.conf.Configurable

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flume.Sink

org.apache.flume.Sink.Status

Field Summary

Fields

Modifier and Type	Field and Description
static String	EVENTS_PER_TRANSACTION_KEY
static String	FILE_BLOCK_SIZE_KEY
static String	FILE_COMPRESSION_KEY
static String	FILE_NAME_KEY
static String	FILE_PAGE_SIZE_KEY
static String	FILE_PATH_KEY
static String	FILE_QUEUE_SIZE_KEY
static String	FILE_SIZE_KEY
static String	TIMEOUT_SECONDS_KEY

Constructor Summary

Constructors

Constructor and Description
HDFSParquetSink()

Method Summary

Modifier and Type	Method and Description
void	configure(org.apache.flume.Context context)
org.apache.flume.Sink.Status	process()
void	start()
void	stop()

Methods inherited from class org.apache.flume.sink.AbstractSink

getChannel, getLifecycleState, getName, setChannel, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

EVENTS_PER_TRANSACTION_KEY

public static final String EVENTS_PER_TRANSACTION_KEY

See Also:

Constant Field Values

FILE_PATH_KEY

public static final String FILE_PATH_KEY

See Also:

Constant Field Values

FILE_NAME_KEY

public static final String FILE_NAME_KEY

See Also:

Constant Field Values

FILE_SIZE_KEY

public static final String FILE_SIZE_KEY

See Also:

Constant Field Values

FILE_PAGE_SIZE_KEY

public static final String FILE_PAGE_SIZE_KEY

See Also:

Constant Field Values

FILE_BLOCK_SIZE_KEY

public static final String FILE_BLOCK_SIZE_KEY

See Also:

Constant Field Values

FILE_COMPRESSION_KEY

public static final String FILE_COMPRESSION_KEY

See Also:

Constant Field Values

FILE_QUEUE_SIZE_KEY

public static final String FILE_QUEUE_SIZE_KEY

See Also:

Constant Field Values

TIMEOUT_SECONDS_KEY

public static final String TIMEOUT_SECONDS_KEY

See Also:

Constant Field Values

Constructor Detail

HDFSParquetSink

public HDFSParquetSink()

Method Detail

start

public void start()

Specified by:

start in interface org.apache.flume.lifecycle.LifecycleAware

Overrides:

start in class org.apache.flume.sink.AbstractSink

stop

public void stop()

Specified by:

stop in interface org.apache.flume.lifecycle.LifecycleAware

Overrides:

stop in class org.apache.flume.sink.AbstractSink

process

public org.apache.flume.Sink.Status process()
                                     throws org.apache.flume.EventDeliveryException

Specified by:

process in interface org.apache.flume.Sink

Throws:

org.apache.flume.EventDeliveryException

configure

public void configure(org.apache.flume.Context context)

Specified by:

configure in interface org.apache.flume.conf.Configurable