程序包 org.apache.pulsar.io.hdfs3.sink.seq

类 HdfsTextSink

java.lang.Object

org.apache.pulsar.io.hdfs3.AbstractHdfsConnector

org.apache.pulsar.io.hdfs3.sink.HdfsAbstractSink<K,V>

org.apache.pulsar.io.hdfs3.sink.seq.HdfsAbstractSequenceFileSink<java.lang.String,java.lang.String,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.pulsar.io.hdfs3.sink.seq.HdfsTextSink

所有已实现的接口:

java.lang.AutoCloseable, org.apache.pulsar.io.core.Sink<java.lang.String>

public class HdfsTextSink
extends HdfsAbstractSequenceFileSink<java.lang.String,java.lang.String,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

A Simple Sink class for Hdfs Sequence File.

字段概要

从类继承的字段 org.apache.pulsar.io.hdfs3.sink.seq.HdfsAbstractSequenceFileSink

counter, hdfsStream, writer

从类继承的字段 org.apache.pulsar.io.hdfs3.sink.HdfsAbstractSink

hdfsSinkConfig, syncThread, unackedRecords

从类继承的字段 org.apache.pulsar.io.hdfs3.AbstractHdfsConnector

compressionCodecFactory, connectorConfig, hdfsResources

构造器概要

构造器

构造器	说明
HdfsTextSink()

方法概要

修饰符和类型	方法	说明
org.apache.pulsar.io.core.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>	convert(org.apache.pulsar.io.core.KeyValue<java.lang.String,java.lang.String> kv)
org.apache.pulsar.io.core.KeyValue<java.lang.String,java.lang.String>	extractKeyValue(org.apache.pulsar.functions.api.Record<java.lang.String> record)
protected java.util.List<org.apache.hadoop.io.SequenceFile.Writer.Option>	getOptions()

从类继承的方法 org.apache.pulsar.io.hdfs3.sink.seq.HdfsAbstractSequenceFileSink

close, createWriter, getWriter, write

从类继承的方法 org.apache.pulsar.io.hdfs3.sink.HdfsAbstractSink

connectToHdfs, getHdfsStream, getOutputStreamBuilder, getPath, launchSyncThread, open

从类继承的方法 org.apache.pulsar.io.hdfs3.AbstractHdfsConnector

checkHdfsUriForTimeout, getCompressionCodec, getCompressionCodecFactory, getConfiguration, getEncoding, getFileSystem, getFileSystem, getFileSystemAsUser, getUserGroupInformation, resetHDFSResources

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.pulsar.io.core.Sink

open

构造器详细资料

HdfsTextSink

public HdfsTextSink()

方法详细资料

getOptions

protected java.util.List<org.apache.hadoop.io.SequenceFile.Writer.Option> getOptions()
                                                                              throws java.lang.IllegalArgumentException,
                                                                                     java.io.IOException

覆盖:

getOptions 在类中 HdfsAbstractSequenceFileSink<java.lang.String,java.lang.String,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

抛出:

java.lang.IllegalArgumentException

java.io.IOException

extractKeyValue

public org.apache.pulsar.io.core.KeyValue<java.lang.String,java.lang.String> extractKeyValue(org.apache.pulsar.functions.api.Record<java.lang.String> record)

指定者:

extractKeyValue 在类中 HdfsAbstractSink<java.lang.String,java.lang.String>

convert

public org.apache.pulsar.io.core.KeyValue<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> convert(org.apache.pulsar.io.core.KeyValue<java.lang.String,java.lang.String> kv)

指定者:

convert 在类中 HdfsAbstractSequenceFileSink<java.lang.String,java.lang.String,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>