org.apache.flink.api.java.hadoop.mapreduce

Class HadoopInputFormat<K,V>

java.lang.Object

org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<T,HadoopInputSplit>

org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase<K,V,Tuple2<K,V>>

org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormat<K,V>

Type Parameters:

K - Key Type

V - Value Type

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.InputFormat<Tuple2<K,V>,HadoopInputSplit>, ResultTypeQueryable<Tuple2<K,V>>, org.apache.flink.core.io.InputSplitSource<HadoopInputSplit>

public class HadoopInputFormat<K,V>
extends HadoopInputFormatBase<K,V,Tuple2<K,V>>
implements ResultTypeQueryable<Tuple2<K,V>>

InputFormat implementation allowing to use Hadoop (mapreduce) InputFormats with Flink.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase

fetched, hasNext, keyClass, recordReader, valueClass

Fields inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

credentials

Constructor Summary

Constructors

Constructor and Description
HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapreduce.Job job)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.api.common.typeinfo.TypeInformation<Tuple2<K,V>>	getProducedType() Gets the data type (as a TypeInformation) produced by this function or input format.
Tuple2<K,V>	nextRecord(Tuple2<K,V> record)

Methods inherited from class org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase

close, configure, createInputSplits, fetchNext, getConfiguration, getInputSplitAssigner, getStatistics, open, reachedEnd

Methods inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

getCredentialsFromUGI, read, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
                         Class<K> key,
                         Class<V> value,
                         org.apache.hadoop.mapreduce.Job job)

Method Detail

nextRecord

public Tuple2<K,V> nextRecord(Tuple2<K,V> record)
                       throws IOException

Specified by:

nextRecord in interface org.apache.flink.api.common.io.InputFormat<Tuple2<K,V>,HadoopInputSplit>

Throws:

IOException

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<Tuple2<K,V>> getProducedType()

Description copied from interface: ResultTypeQueryable

Gets the data type (as a TypeInformation) produced by this function or input format.

Specified by:

getProducedType in interface ResultTypeQueryable<Tuple2<K,V>>

Returns:

The data type produced by this function or input format.