org.apache.pulsar.functions.source.batch

Class BatchSourceExecutor<T>

java.lang.Object

org.apache.pulsar.functions.source.batch.BatchSourceExecutor<T>

All Implemented Interfaces:

AutoCloseable, Source<T>

public class BatchSourceExecutor<T>
extends Object
implements Source<T>

BatchSourceExecutor wraps BatchSource as Source. Thus from Pulsar IO perspective, it is running a regular streaming source. The BatchSourceExecutor orchestrates the lifecycle of BatchSource. The current implementation uses an intermediate topic between the discovery process and the actual batchsource instances. The Discovery is run on 0th instance. Any tasks discovered during the discover are written to the intermediate topic. All the instances consume tasks from this intermediate topic using a shared subscription.

Constructor Summary

Constructors

Constructor and Description
BatchSourceExecutor()

Method Summary

Modifier and Type	Method and Description
void	close()
void	open(Map<String,Object> config, SourceContext sourceContext)
Record<T>	read()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BatchSourceExecutor

public BatchSourceExecutor()

Method Detail

open

public void open(Map<String,Object> config,
                 SourceContext sourceContext)
          throws Exception

Specified by:

open in interface Source<T>

Throws:

Exception

read

public Record<T> read()
               throws Exception

Specified by:

read in interface Source<T>

Throws:

Exception

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Throws:

Exception