cascading.tap.local.hadoop

Class LocalHfsAdaptor

java.lang.Object

cascading.tap.Tap<TConfig,TInput,TOutput>

cascading.tap.AdaptorTap<TConfig,TInput,TOutput,OConfig,OInput,OOutput>

cascading.tap.FileAdaptorTap<java.util.Properties,java.io.InputStream,java.io.OutputStream,Configuration,RecordReader,OutputCollector>

cascading.tap.local.hadoop.LocalHfsAdaptor

All Implemented Interfaces:

cascading.flow.FlowElement, cascading.flow.planner.ScopedElement, cascading.tap.type.FileType<java.util.Properties>, cascading.util.Traceable, java.io.Serializable

public class LocalHfsAdaptor
extends cascading.tap.FileAdaptorTap<java.util.Properties,java.io.InputStream,java.io.OutputStream,Configuration,RecordReader,OutputCollector>

Class LocalHfsAdaptor adapts the Hadoop Hfs Tap for use with the LocalFlowConnector and LocalPlanner.

That is, "local mode" Cascading application can access data on an Apache Hadoop HDFS cluster if the proper Hadoop properties on are set on the LocalFlowConnector instance.

Use this class in order to leverage existing Scheme implementations that wrap Hadoop InputFormat and OutputFormat implementations.

See Also:

Serialized Form

Field Summary

Fields inherited from class cascading.tap.AdaptorTap

configProvider, original, processProvider

Fields inherited from interface cascading.tap.type.FileType

CASCADING_SOURCE_PATH

Constructor Summary

Constructors

Constructor and Description
LocalHfsAdaptor(cascading.tap.Tap<Configuration,RecordReader,OutputCollector> original)

Method Summary

Methods inherited from class cascading.tap.FileAdaptorTap

getChildIdentifiers, getChildIdentifiers, getChildIdentifiers, getChildIdentifiers, getFileOriginal, getSize, getSize, isDirectory, isDirectory

Methods inherited from class cascading.tap.AdaptorTap

commitResource, createResource, createResource, deleteResource, deleteResource, equals, flowConfInit, getConfigDef, getFullIdentifier, getFullIdentifier, getIdentifier, getModifiedTime, getModifiedTime, getNodeConfigDef, getOriginal, getScheme, getSinkFields, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hashCode, hasNodeConfigDef, hasStepConfigDef, isKeep, isReplace, isSink, isSource, isTemporary, isUpdate, openForRead, openForRead, openForWrite, openForWrite, outgoingScopeFor, prepareResourceForRead, prepareResourceForWrite, presentSinkFields, presentSourceFields, resolveIncomingOperationArgumentFields, resolveIncomingOperationPassThroughFields, resourceExists, resourceExists, retrieveSinkFields, retrieveSourceFields, rollbackResource, setOriginal, sinkConfInit, sourceConfInit, toString

Methods inherited from class cascading.tap.Tap

entryStream, entryStream, entryStreamCopy, entryStreamCopy, id, openForReadUnchecked, setScheme, spliterator, splititerator, taps, tupleStream, tupleStream, tupleStreamCopy, tupleStreamCopy

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

LocalHfsAdaptor

@ConstructorProperties(value="original")
public LocalHfsAdaptor(cascading.tap.Tap<Configuration,RecordReader,OutputCollector> original)