org.apache.flink.hadoopcompatibility.mapreduce

Class HadoopOutputFormat<K extends Writable,V extends Writable>

java.lang.Object

org.apache.flink.hadoopcompatibility.mapreduce.HadoopOutputFormat<K,V>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.OutputFormat<Tuple2<K,V>>

public class HadoopOutputFormat<K extends Writable,V extends Writable>
extends Object
implements org.apache.flink.api.common.io.OutputFormat<Tuple2<K,V>>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HadoopOutputFormat(org.apache.hadoop.mapreduce.OutputFormat<K,V> mapreduceOutputFormat, org.apache.hadoop.mapreduce.Job job)

Method Summary

Methods

Modifier and Type	Method and Description
void	close() commit the task by moving the output file out from the temporary directory.
void	configure(org.apache.flink.configuration.Configuration parameters)
org.apache.hadoop.conf.Configuration	getConfiguration()
org.apache.hadoop.mapreduce.OutputFormat<K,V>	getHadoopOutputFormat()
void	open(int taskNumber, int numTasks) create the temporary output file for hadoop RecordWriter.
void	setConfiguration(org.apache.hadoop.conf.Configuration configuration)
void	setHadoopOutputFormat(org.apache.hadoop.mapreduce.OutputFormat<K,V> mapreduceOutputFormat)
void	writeRecord(Tuple2<K,V> record)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopOutputFormat

public HadoopOutputFormat(org.apache.hadoop.mapreduce.OutputFormat<K,V> mapreduceOutputFormat,
                  org.apache.hadoop.mapreduce.Job job)

Method Detail

setConfiguration

public void setConfiguration(org.apache.hadoop.conf.Configuration configuration)

getConfiguration

public org.apache.hadoop.conf.Configuration getConfiguration()

getHadoopOutputFormat

public org.apache.hadoop.mapreduce.OutputFormat<K,V> getHadoopOutputFormat()

setHadoopOutputFormat

public void setHadoopOutputFormat(org.apache.hadoop.mapreduce.OutputFormat<K,V> mapreduceOutputFormat)

configure

public void configure(org.apache.flink.configuration.Configuration parameters)

Specified by:

configure in interface org.apache.flink.api.common.io.OutputFormat<Tuple2<K extends Writable,V extends Writable>>

open

public void open(int taskNumber,
        int numTasks)
          throws IOException

create the temporary output file for hadoop RecordWriter.

Specified by:

open in interface org.apache.flink.api.common.io.OutputFormat<Tuple2<K extends Writable,V extends Writable>>

Parameters:

taskNumber - The number of the parallel instance.

numTasks - The number of parallel tasks.

Throws:

IOException

writeRecord

public void writeRecord(Tuple2<K,V> record)
                 throws IOException

Specified by:

writeRecord in interface org.apache.flink.api.common.io.OutputFormat<Tuple2<K extends Writable,V extends Writable>>

Throws:

IOException

close

public void close()
           throws IOException

commit the task by moving the output file out from the temporary directory.

Specified by:

close in interface org.apache.flink.api.common.io.OutputFormat<Tuple2<K extends Writable,V extends Writable>>

Throws:

IOException