org.apache.flink.api.java.hadoop.mapred

Class HadoopInputFormat<K,V>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<T,SPITTYPE>

org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase<T,HadoopInputSplit>

org.apache.flink.api.java.hadoop.mapred.HadoopInputFormatBase<K,V,org.apache.flink.api.java.tuple.Tuple2<K,V>>

org.apache.flink.api.java.hadoop.mapred.HadoopInputFormat<K,V>

Type Parameters:

K - Type of the key

V - Type of the value.

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.InputFormat<org.apache.flink.api.java.tuple.Tuple2<K,V>,HadoopInputSplit>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<K,V>>, org.apache.flink.core.io.InputSplitSource<HadoopInputSplit>

@Public
public class HadoopInputFormat<K,V>
extends HadoopInputFormatBase<K,V,org.apache.flink.api.java.tuple.Tuple2<K,V>>
implements org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<K,V>>

Wrapper for using HadoopInputFormats (mapred-variant) with Flink.

The IF is returning a Tuple2<K,V>.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.api.java.hadoop.mapred.HadoopInputFormatBase

fetched, hasNext, key, keyClass, value, valueClass

Fields inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

credentials

Constructor Summary

Constructors

Constructor and Description
HadoopInputFormat(org.apache.hadoop.mapred.InputFormat<K,V> mapredInputFormat, Class<K> key, Class<V> value)
HadoopInputFormat(org.apache.hadoop.mapred.InputFormat<K,V> mapredInputFormat, Class<K> key, Class<V> value, org.apache.hadoop.mapred.JobConf job)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<K,V>>	getProducedType()
org.apache.flink.api.java.tuple.Tuple2<K,V>	nextRecord(org.apache.flink.api.java.tuple.Tuple2<K,V> record)

Methods inherited from class org.apache.flink.api.java.hadoop.mapred.HadoopInputFormatBase

close, configure, createInputSplits, fetchNext, getInputSplitAssigner, getJobConf, getStatistics, open, reachedEnd

Methods inherited from class org.apache.flink.api.java.hadoop.common.HadoopInputFormatCommonBase

getCredentialsFromUGI, read, write

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapred.InputFormat<K,V> mapredInputFormat,
                         Class<K> key,
                         Class<V> value,
                         org.apache.hadoop.mapred.JobConf job)

HadoopInputFormat

public HadoopInputFormat(org.apache.hadoop.mapred.InputFormat<K,V> mapredInputFormat,
                         Class<K> key,
                         Class<V> value)

Method Detail

nextRecord

public org.apache.flink.api.java.tuple.Tuple2<K,V> nextRecord(org.apache.flink.api.java.tuple.Tuple2<K,V> record)
                                                       throws IOException

Specified by:

nextRecord in interface org.apache.flink.api.common.io.InputFormat<org.apache.flink.api.java.tuple.Tuple2<K,V>,HadoopInputSplit>

Throws:

IOException

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<K,V>> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<K,V>>