org.apache.gobblin.eventhub.writer

Class EventhubDataWriter

java.lang.Object

org.apache.gobblin.eventhub.writer.EventhubDataWriter

All Implemented Interfaces:

Closeable, AutoCloseable, BatchAsyncDataWriter<String>, SyncDataWriter<String>

public class EventhubDataWriter
extends Object
implements SyncDataWriter<String>, BatchAsyncDataWriter<String>

Data Writer for Eventhub. This Data Writer use HttpClient internally and publish data to Eventhub via Post REST API Synchronous model is used here that after each data is sent through httpClient, a response is consumed immediately. Also this class supports sending multiple records in a batch manner. The String input needs to be Unicode based because it will convert to JSON format when using REST API For batch sending, please refer to https://docs.microsoft.com/en-us/rest/api/eventhub/send-batch-events for sending batch records For unicode based json string, please refer to http://rfc7159.net/

Constructor Summary

Constructors

Constructor and Description
EventhubDataWriter(Properties properties) User needs to provide eventhub properties
EventhubDataWriter(Properties properties, org.apache.http.client.HttpClient httpclient) User needs to provide eventhub properties and an httpClient

Method Summary

Modifier and Type	Method and Description
void	cleanup()
void	close() Close the HttpClient
void	flush()
void	refreshSignature() A signature which contains the duration.
Future<WriteResponse>	write(Batch<String> batch, WriteCallback callback) Write a whole batch to eventhub
WriteResponse	write(String record) Write a single record to eventhub

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EventhubDataWriter

public EventhubDataWriter(Properties properties)

User needs to provide eventhub properties

EventhubDataWriter

public EventhubDataWriter(Properties properties,
                          org.apache.http.client.HttpClient httpclient)

User needs to provide eventhub properties and an httpClient

Method Detail

write

public Future<WriteResponse> write(Batch<String> batch,
                                   WriteCallback callback)

Write a whole batch to eventhub

Specified by:

write in interface BatchAsyncDataWriter<String>

write

public WriteResponse write(String record)
                    throws IOException

Write a single record to eventhub

Specified by:

write in interface SyncDataWriter<String>

Throws:

IOException

refreshSignature

public void refreshSignature()

A signature which contains the duration. After the duration is expired, the signature becomes invalid

close

public void close()
           throws IOException

Close the HttpClient

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

cleanup

public void cleanup()

Specified by:

cleanup in interface SyncDataWriter<String>

flush

public void flush()

Specified by:

flush in interface BatchAsyncDataWriter<String>