org.apache.flink.streaming.connectors.fs

类 SequenceFileWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.flink.streaming.connectors.fs.StreamWriterBase<org.apache.flink.api.java.tuple.Tuple2<K,V>>

org.apache.flink.streaming.connectors.fs.SequenceFileWriter<K,V>

类型参数:

K - The type of the first tuple field.

V - The type of the second tuple field.

所有已实现的接口:

Serializable, org.apache.flink.api.java.typeutils.InputTypeConfigurable, Writer<org.apache.flink.api.java.tuple.Tuple2<K,V>>

public class SequenceFileWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>
extends StreamWriterBase<org.apache.flink.api.java.tuple.Tuple2<K,V>>
implements org.apache.flink.api.java.typeutils.InputTypeConfigurable

A Writer that writes the bucket files as Hadoop SequenceFiles. The input to the BucketingSink must be a Tuple2 of two Hadoop Writables.

另请参阅:

序列化表格

构造器概要

构造器

限定符	构造器和说明
	SequenceFileWriter() Creates a new SequenceFileWriter that writes sequence files without compression.
protected	SequenceFileWriter(SequenceFileWriter<K,V> other)
	SequenceFileWriter(String compressionCodecName, org.apache.hadoop.io.SequenceFile.CompressionType compressionType) Creates a new SequenceFileWriter that writes sequence with the given compression codec and compression type.

方法概要

限定符和类型	方法和说明
void	close() Closes the Writer.
SequenceFileWriter<K,V>	duplicate() Duplicates the Writer.
void	open(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) Initializes the Writer for a newly opened bucket file.
void	setInputType(org.apache.flink.api.common.typeinfo.TypeInformation<?> type, org.apache.flink.api.common.ExecutionConfig executionConfig)
void	write(org.apache.flink.api.java.tuple.Tuple2<K,V> element) Writes one element to the bucket file.

从类继承的方法 org.apache.flink.streaming.connectors.fs.StreamWriterBase

flush, getPos, getStream, isSyncOnFlush, setSyncOnFlush

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SequenceFileWriter

public SequenceFileWriter()

Creates a new SequenceFileWriter that writes sequence files without compression.

SequenceFileWriter

public SequenceFileWriter(String compressionCodecName,
                          org.apache.hadoop.io.SequenceFile.CompressionType compressionType)

Creates a new SequenceFileWriter that writes sequence with the given compression codec and compression type.

参数:

compressionCodecName - Name of a Hadoop Compression Codec.

compressionType - The compression type to use.

SequenceFileWriter

protected SequenceFileWriter(SequenceFileWriter<K,V> other)

方法详细资料

open

public void open(org.apache.hadoop.fs.FileSystem fs,
                 org.apache.hadoop.fs.Path path)
          throws IOException

从接口复制的说明: Writer

Initializes the Writer for a newly opened bucket file. Any internal per-bucket initialization should be performed here.

指定者:

open 在接口中 Writer<org.apache.flink.api.java.tuple.Tuple2<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>>

覆盖:

open 在类中 StreamWriterBase<org.apache.flink.api.java.tuple.Tuple2<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>>

参数:

fs - The FileSystem containing the newly opened file.

path - The Path of the newly opened file.

抛出:

IOException

close

public void close()
           throws IOException

从接口复制的说明: Writer

Closes the Writer. If the writer is already closed, no action will be taken. The call should close all state related to the current output file, including the output stream opened in open.

指定者:

close 在接口中 Writer<org.apache.flink.api.java.tuple.Tuple2<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>>

覆盖:

close 在类中 StreamWriterBase<org.apache.flink.api.java.tuple.Tuple2<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>>

抛出:

IOException

write

public void write(org.apache.flink.api.java.tuple.Tuple2<K,V> element)
           throws IOException

从接口复制的说明: Writer

Writes one element to the bucket file.

指定者:

write 在接口中 Writer<org.apache.flink.api.java.tuple.Tuple2<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>>

抛出:

IOException

setInputType

public void setInputType(org.apache.flink.api.common.typeinfo.TypeInformation<?> type,
                         org.apache.flink.api.common.ExecutionConfig executionConfig)

指定者:

setInputType 在接口中 org.apache.flink.api.java.typeutils.InputTypeConfigurable

duplicate

public SequenceFileWriter<K,V> duplicate()

从接口复制的说明: Writer

Duplicates the Writer. This is used to get one Writer for each parallel instance of the sink.

指定者:

duplicate 在接口中 Writer<org.apache.flink.api.java.tuple.Tuple2<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable>>