org.apache.flink.hadoopcompatibility.mapred

Class HadoopMapFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.api.common.functions.RichFlatMapFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

org.apache.flink.hadoopcompatibility.mapred.HadoopMapFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.FlatMapFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

@Public
public final class HadoopMapFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
extends org.apache.flink.api.common.functions.RichFlatMapFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>
implements org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>, Serializable

This wrapper maps a Hadoop Mapper (mapred API) to a Flink FlatMapFunction.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HadoopMapFunction(org.apache.hadoop.mapred.Mapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopMapper) Maps a Hadoop Mapper (mapred API) to a Flink FlatMapFunction.
HadoopMapFunction(org.apache.hadoop.mapred.Mapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopMapper, org.apache.hadoop.mapred.JobConf conf) Maps a Hadoop Mapper (mapred API) to a Flink FlatMapFunction.

Method Summary

Modifier and Type	Method and Description
void	flatMap(org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN> value, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> out)
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>	getProducedType()
void	open(org.apache.flink.configuration.Configuration parameters)

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopMapFunction

public HadoopMapFunction(org.apache.hadoop.mapred.Mapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopMapper)

Maps a Hadoop Mapper (mapred API) to a Flink FlatMapFunction.

Parameters:

hadoopMapper - The Hadoop Mapper to wrap.

HadoopMapFunction

public HadoopMapFunction(org.apache.hadoop.mapred.Mapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT> hadoopMapper,
                         org.apache.hadoop.mapred.JobConf conf)

Maps a Hadoop Mapper (mapred API) to a Flink FlatMapFunction. The Hadoop Mapper is configured with the provided JobConf.

Parameters:

hadoopMapper - The Hadoop Mapper to wrap.

conf - The JobConf that is used to configure the Hadoop Mapper.

Method Detail

open

public void open(org.apache.flink.configuration.Configuration parameters)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

flatMap

public void flatMap(org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN> value,
                    org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> out)
             throws Exception

Specified by:

flatMap in interface org.apache.flink.api.common.functions.FlatMapFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

Specified by:

flatMap in class org.apache.flink.api.common.functions.RichFlatMapFunction<org.apache.flink.api.java.tuple.Tuple2<KEYIN,VALUEIN>,org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>

Throws:

Exception

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.api.java.tuple.Tuple2<KEYOUT,VALUEOUT>>