org.pentaho.di.core.compress.hadoopsnappy

类 HadoopSnappyCompressionProvider

java.lang.Object

org.pentaho.di.core.compress.hadoopsnappy.HadoopSnappyCompressionProvider

所有已实现的接口:

CompressionProvider

public class HadoopSnappyCompressionProvider
extends Object
implements CompressionProvider

字段概要

字段

限定符和类型	字段和说明
static int	IO_COMPRESSION_CODEC_SNAPPY_DEFAULT_BUFFERSIZE

构造器概要

构造器

构造器和说明
HadoopSnappyCompressionProvider()

方法概要

限定符和类型	方法和说明
HadoopSnappyCompressionInputStream	createInputStream(InputStream in) Creates an input stream that decompresses data (according to the provider's implementation)
HadoopSnappyCompressionOutputStream	createOutputStream(OutputStream out) Creates an output stream that compresses data (according to the provider's implementation)
static Object	getActiveSnappyShim() Locate the Snappy Shim for the active Hadoop Configuration via the Hadoop Configuration Util
String	getDefaultExtension() Gets the default file extension for this provider.
String	getDescription() Gets the name of this provider.
String	getName() Gets the name of this provider.
static boolean	isHadoopSnappyAvailable() Tests whether hadoop-snappy (not to be confused with other java-based snappy implementations such as jsnappy or snappy-java) plus the native snappy libraries are available.
boolean	supportsInput() Whether this compression provider supports input streams
boolean	supportsOutput() Whether this compression provider supports output streams

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

IO_COMPRESSION_CODEC_SNAPPY_DEFAULT_BUFFERSIZE

public static final int IO_COMPRESSION_CODEC_SNAPPY_DEFAULT_BUFFERSIZE

另请参阅:

常量字段值

构造器详细资料

HadoopSnappyCompressionProvider

public HadoopSnappyCompressionProvider()

方法详细资料

getActiveSnappyShim

public static Object getActiveSnappyShim()
                                  throws Exception

Locate the Snappy Shim for the active Hadoop Configuration via the Hadoop Configuration Util

返回:

A org.pentaho.hadoop.shim.spi.SnappyShim to interact with Snappy

抛出:

Exception - Error locating a valid Snappy shim:

• org.pentaho.hadoop.hive.jdbc.HadoopConfigurationUtil could not be located
• No active Hadoop configuration
• Active Hadoop configuration doesn't support Snappy

isHadoopSnappyAvailable

public static boolean isHadoopSnappyAvailable()

Tests whether hadoop-snappy (not to be confused with other java-based snappy implementations such as jsnappy or snappy-java) plus the native snappy libraries are available.

返回:

true if hadoop-snappy is available on the classpath

createInputStream

public HadoopSnappyCompressionInputStream createInputStream(InputStream in)
                                                     throws IOException

从接口复制的说明: CompressionProvider

Creates an input stream that decompresses data (according to the provider's implementation)

指定者:

createInputStream 在接口中 CompressionProvider

参数:

in - An existing input stream to wrap

返回:

a CompressionInputStream object that decompresses incoming data

抛出:

IOException

supportsInput

public boolean supportsInput()

从接口复制的说明: CompressionProvider

Whether this compression provider supports input streams

指定者:

supportsInput 在接口中 CompressionProvider

返回:

true if the provider supports input streams, false otherwise

createOutputStream

public HadoopSnappyCompressionOutputStream createOutputStream(OutputStream out)
                                                       throws IOException

从接口复制的说明: CompressionProvider

Creates an output stream that compresses data (according to the provider's implementation)

指定者:

createOutputStream 在接口中 CompressionProvider

参数:

out - An existing output stream to wrap

返回:

a CompressionOutputStream object that compresses outgoing data

抛出:

IOException

supportsOutput

public boolean supportsOutput()

从接口复制的说明: CompressionProvider

Whether this compression provider supports output streams

指定者:

supportsOutput 在接口中 CompressionProvider

返回:

true if the provider supports output streams, false otherwise

getDescription

public String getDescription()

从接口复制的说明: CompressionProvider

Gets the name of this provider. Used for display e.g.

指定者:

getDescription 在接口中 CompressionProvider

返回:

A String containing a description of this provider

getName

public String getName()

从接口复制的说明: CompressionProvider

Gets the name of this provider. Used for display and as a reference in saved artifacts (transformations, e.g.)

指定者:

getName 在接口中 CompressionProvider

返回:

A String containing the name of this provider

getDefaultExtension

public String getDefaultExtension()

从接口复制的说明: CompressionProvider

Gets the default file extension for this provider. If the streams are wrapped in File streams, this method can be used to determine an appropriate extension to append to the filename so the file will be recognized as an artifact of the compression mechanism (.zip, .bz2, e.g.)

指定者:

getDefaultExtension 在接口中 CompressionProvider

返回:

A String containing the default file extension for this provider