org.apache.flink.api.java.hadoop.mapreduce

Class HadoopInputFormat<K,V>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<T,SPITTYPE>

org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<T,HadoopInputSplit>

org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase<K,V,Tuple2<K,V>>

org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormat<K,V>

Type Parameters:

K - Key Type

V - Value Type

All Implemented Interfaces:

Serializable, InputFormat<Tuple2<K,V>,HadoopInputSplit>, ResultTypeQueryable<Tuple2<K,V>>, InputSplitSource<HadoopInputSplit>

@Public
public class HadoopInputFormat<K,V>
extends HadoopInputFormatBase<K,V,Tuple2<K,V>>
implements ResultTypeQueryable<Tuple2<K,V>>

InputFormat implementation allowing to use Hadoop (mapreduce) InputFormats with Flink.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase

fetched, hasNext, keyClass, recordReader, valueClass

Fields inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

credentials

Constructor Summary

Constructors

Constructor and Description
HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value)
HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapreduce.Job job)

Method Summary

Methods

Modifier and Type	Method and Description
TypeInformation<Tuple2<K,V>>	getProducedType()
Tuple2<K,V>	nextRecord(Tuple2<K,V> record)

Methods inherited from class org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase

close, configure, createInputSplits, fetchNext, getConfiguration, getInputSplitAssigner, getStatistics, open, reachedEnd

Methods inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

getCredentialsFromUGI, read, write

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
                 Class<K> key,
                 Class<V> value,
                 org.apache.hadoop.mapreduce.Job job)

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
                 Class<K> key,
                 Class<V> value)
                  throws IOException

Throws:

IOException

Method Detail

nextRecord

public Tuple2<K,V> nextRecord(Tuple2<K,V> record)
                       throws IOException

Specified by:

nextRecord in interface InputFormat<Tuple2<K,V>,HadoopInputSplit>

Throws:

IOException

getProducedType

public TypeInformation<Tuple2<K,V>> getProducedType()

Specified by:

getProducedType in interface ResultTypeQueryable<Tuple2<K,V>>