Package org.apache.pulsar.io.hdfs2.sink.text

Class HdfsStringSink

java.lang.Object

org.apache.pulsar.io.hdfs2.AbstractHdfsConnector

org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink<K,V>

org.apache.pulsar.io.hdfs2.sink.text.HdfsAbstractTextFileSink<String,String>

org.apache.pulsar.io.hdfs2.sink.text.HdfsStringSink

All Implemented Interfaces:

AutoCloseable, org.apache.pulsar.io.core.Sink<String>

public class HdfsStringSink
extends HdfsAbstractTextFileSink<String,String>
implements org.apache.pulsar.io.core.Sink<String>

A Simple Sink class for Hdfs Text File.

Field Summary

Fields inherited from class org.apache.pulsar.io.hdfs2.sink.text.HdfsAbstractTextFileSink

writer

Fields inherited from class org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink

hdfsSinkConfig, syncThread, unackedRecords

Fields inherited from class org.apache.pulsar.io.hdfs2.AbstractHdfsConnector

compressionCodecFactory, connectorConfig, hdfsResources

Constructor Summary

Constructors

Constructor	Description
HdfsStringSink()

Method Summary

Modifier and Type	Method	Description
org.apache.pulsar.io.core.KeyValue<String,String>	extractKeyValue(org.apache.pulsar.functions.api.Record<String> record)

Methods inherited from class org.apache.pulsar.io.hdfs2.sink.text.HdfsAbstractTextFileSink

close, createWriter, write

Methods inherited from class org.apache.pulsar.io.hdfs2.sink.HdfsAbstractSink

connectToHdfs, getHdfsStream, getPath, launchSyncThread, open

Methods inherited from class org.apache.pulsar.io.hdfs2.AbstractHdfsConnector

checkHdfsUriForTimeout, getCompressionCodec, getCompressionCodecFactory, getConfiguration, getEncoding, getFileSystem, getFileSystem, getFileSystemAsUser, getUserGroupInformation, resetHDFSResources

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.AutoCloseable

close

Methods inherited from interface org.apache.pulsar.io.core.Sink

open, write

Constructor Details

HdfsStringSink

public HdfsStringSink()

Method Details

extractKeyValue

public org.apache.pulsar.io.core.KeyValue<String,String> extractKeyValue(org.apache.pulsar.functions.api.Record<String> record)

Specified by:

extractKeyValue in class HdfsAbstractSink<String,String>