org.apache.flink.api.java.hadoop.mapreduce

Class HadoopInputFormat<K,V>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<T,SPITTYPE>

org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<T,HadoopInputSplit>

org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase<K,V,org.apache.flink.api.java.tuple.Tuple2<K,V>>

org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormat<K,V>

Type Parameters:

K - Key Type

V - Value Type

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.InputFormat<org.apache.flink.api.java.tuple.Tuple2<K,V>,HadoopInputSplit>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<K,V>>, org.apache.flink.core.io.InputSplitSource<HadoopInputSplit>

@Public
public class HadoopInputFormat<K,V>
extends HadoopInputFormatBase<K,V,org.apache.flink.api.java.tuple.Tuple2<K,V>>
implements org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<K,V>>

InputFormat implementation allowing to use Hadoop (mapreduce) InputFormats with Flink.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase

fetched, hasNext, keyClass, recordReader, valueClass

Fields inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

credentials

Constructor Summary

Constructors

Constructor and Description
HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value)
HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapreduce.Job job)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<K,V>>	getProducedType()
org.apache.flink.api.java.tuple.Tuple2<K,V>	nextRecord(org.apache.flink.api.java.tuple.Tuple2<K,V> record)

Methods inherited from class org.apache.flink.api.java.hadoop.mapreduce.HadoopInputFormatBase

close, configure, createInputSplits, fetchNext, getConfiguration, getInputSplitAssigner, getStatistics, open, reachedEnd

Methods inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

getCredentialsFromUGI, read, write

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
                         Class<K> key,
                         Class<V> value,
                         org.apache.hadoop.mapreduce.Job job)

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapreduce.InputFormat<K,V> mapreduceInputFormat,
                         Class<K> key,
                         Class<V> value)
                  throws IOException

Throws:

IOException

Method Detail

nextRecord

public org.apache.flink.api.java.tuple.Tuple2<K,V> nextRecord(org.apache.flink.api.java.tuple.Tuple2<K,V> record)
                                                       throws IOException

Specified by:

nextRecord in interface org.apache.flink.api.common.io.InputFormat<org.apache.flink.api.java.tuple.Tuple2<K,V>,HadoopInputSplit>

Throws:

IOException

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<K,V>> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<K,V>>