org.apache.flink.connector.firehose.sink

Class KinesisFirehoseSink<InputT>

java.lang.Object

org.apache.flink.connector.base.sink.AsyncSinkBase<InputT,software.amazon.awssdk.services.firehose.model.Record>

org.apache.flink.connector.firehose.sink.KinesisFirehoseSink<InputT>

Type Parameters:

InputT - Type of the elements handled by this sink

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.sink2.Sink<InputT>, org.apache.flink.api.connector.sink2.StatefulSink<InputT,org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>>

@PublicEvolving
public class KinesisFirehoseSink<InputT>
extends org.apache.flink.connector.base.sink.AsyncSinkBase<InputT,software.amazon.awssdk.services.firehose.model.Record>

A Kinesis Data Firehose (KDF) Sink that performs async requests against a destination delivery stream using the buffering protocol specified in AsyncSinkBase.

The sink internally uses a FirehoseAsyncClient to communicate with the AWS endpoint.

Please see the writer implementation in KinesisFirehoseSinkWriter

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.StatefulSink

org.apache.flink.api.connector.sink2.StatefulSink.StatefulSinkWriter<InputT,WriterStateT>, org.apache.flink.api.connector.sink2.StatefulSink.WithCompatibleState

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.Sink

org.apache.flink.api.connector.sink2.Sink.InitContext

Method Summary

Modifier and Type	Method and Description
static <InputT> KinesisFirehoseSinkBuilder<InputT>	builder() Create a KinesisFirehoseSinkBuilder to allow the fluent construction of a new KinesisFirehoseSink.
org.apache.flink.api.connector.sink2.StatefulSink.StatefulSinkWriter<InputT,org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>>	createWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context)
org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>>	getWriterStateSerializer()
org.apache.flink.api.connector.sink2.StatefulSink.StatefulSinkWriter<InputT,org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>>	restoreWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context, Collection<org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>> recoveredState)

Methods inherited from class org.apache.flink.connector.base.sink.AsyncSinkBase

getElementConverter, getMaxBatchSize, getMaxBatchSizeInBytes, getMaxBufferedRequests, getMaxInFlightRequests, getMaxRecordSizeInBytes, getMaxTimeInBufferMS

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

builder

public static <InputT> KinesisFirehoseSinkBuilder<InputT> builder()

Create a KinesisFirehoseSinkBuilder to allow the fluent construction of a new KinesisFirehoseSink.

Type Parameters:

InputT - type of incoming records

Returns:

KinesisFirehoseSinkBuilder

createWriter

public org.apache.flink.api.connector.sink2.StatefulSink.StatefulSinkWriter<InputT,org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>> createWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context)
                                                                                                                                                                                                                  throws IOException

Throws:

IOException

restoreWriter

public org.apache.flink.api.connector.sink2.StatefulSink.StatefulSinkWriter<InputT,org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>> restoreWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context,
                                                                                                                                                                                                                          Collection<org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>> recoveredState)
                                                                                                                                                                                                                   throws IOException

Throws:

IOException

getWriterStateSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.connector.base.sink.writer.BufferedRequestState<software.amazon.awssdk.services.firehose.model.Record>> getWriterStateSerializer()