Package org.apache.pulsar.io.kafka

Class KafkaAbstractSource<V>

java.lang.Object

org.apache.pulsar.io.core.AbstractPushSource<T>

org.apache.pulsar.io.core.PushSource<V>

org.apache.pulsar.io.kafka.KafkaAbstractSource<V>

All Implemented Interfaces:

AutoCloseable, Source<V>

Direct Known Subclasses:

KafkaBytesSource, KafkaStringSource

public abstract class KafkaAbstractSource<V>
extends PushSource<V>

Simple Kafka Source to transfer messages from a Kafka topic.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
protected static class	KafkaAbstractSource.KafkaRecord<V>
protected static class	KafkaAbstractSource.KeyValueKafkaRecord<K,W>

Field Summary

Fields

Modifier and Type	Field	Description
static final String	HEADER_KAFKA_OFFSET_KEY
static final String	HEADER_KAFKA_PTN_KEY
static final String	HEADER_KAFKA_TOPIC_KEY

Constructor Summary

Constructors

Constructor	Description
KafkaAbstractSource()

Method Summary

Modifier and Type	Method	Description
protected Properties	beforeCreateConsumer(Properties props)
abstract KafkaAbstractSource.KafkaRecord<V>	buildRecord(org.apache.kafka.clients.consumer.ConsumerRecord<Object,Object> consumerRecord)
void	close()
protected Map<String,String>	copyKafkaHeaders(org.apache.kafka.clients.consumer.ConsumerRecord<Object,Object> consumerRecord)
void	open(Map<String,Object> config, SourceContext sourceContext)
void	start()

Methods inherited from class org.apache.pulsar.io.core.PushSource

read

Methods inherited from class org.apache.pulsar.io.core.AbstractPushSource

consume, getQueueLength, notifyError, readNext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

HEADER_KAFKA_TOPIC_KEY

public static final String HEADER_KAFKA_TOPIC_KEY

See Also:

• Constant Field Values

HEADER_KAFKA_PTN_KEY

public static final String HEADER_KAFKA_PTN_KEY

See Also:

• Constant Field Values

HEADER_KAFKA_OFFSET_KEY

public static final String HEADER_KAFKA_OFFSET_KEY

See Also:

• Constant Field Values

Constructor Details

KafkaAbstractSource

public KafkaAbstractSource()

Method Details

open

public void open(Map<String,Object> config,
 SourceContext sourceContext)
          throws Exception

Throws:

Exception

beforeCreateConsumer

protected Properties beforeCreateConsumer(Properties props)

close

public void close()
           throws InterruptedException

Throws:

InterruptedException

start

public void start()

buildRecord

public abstract KafkaAbstractSource.KafkaRecord<V> buildRecord(org.apache.kafka.clients.consumer.ConsumerRecord<Object,Object> consumerRecord)

copyKafkaHeaders

protected Map<String,String> copyKafkaHeaders(org.apache.kafka.clients.consumer.ConsumerRecord<Object,Object> consumerRecord)