org.apache.flink.streaming.connectors.kafka

Class FlinkKafkaProducer08<IN>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.sink.RichSinkFunction<IN>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase<IN>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer08<IN>

Type Parameters:

IN - Type of the messages to write into Kafka.

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.streaming.api.functions.sink.SinkFunction<IN>

Direct Known Subclasses:

FlinkKafkaProducer

public class FlinkKafkaProducer08<IN>
extends org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase<IN>

Flink Sink to produce data into a Kafka topic. This producer is compatible with Kafka 0.8. Please note that this producer does not have any reliability guarantees.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase

asyncException, callback, KEY_DISABLE_METRICS, logFailuresOnly, partitioner, partitions, producer, producerConfig, schema, topicId

Constructor Summary

Constructors

Constructor and Description
FlinkKafkaProducer08(String topicId, org.apache.flink.streaming.util.serialization.KeyedSerializationSchema<IN> serializationSchema, Properties producerConfig) Creates a FlinkKafkaProducer for a given topic.
FlinkKafkaProducer08(String topicId, org.apache.flink.streaming.util.serialization.KeyedSerializationSchema<IN> serializationSchema, Properties producerConfig, org.apache.flink.streaming.connectors.kafka.partitioner.KafkaPartitioner<IN> customPartitioner) The main constructor for creating a FlinkKafkaProducer.
FlinkKafkaProducer08(String topicId, org.apache.flink.streaming.util.serialization.SerializationSchema<IN> serializationSchema, Properties producerConfig) Creates a FlinkKafkaProducer for a given topic.
FlinkKafkaProducer08(String topicId, org.apache.flink.streaming.util.serialization.SerializationSchema<IN> serializationSchema, Properties producerConfig, org.apache.flink.streaming.connectors.kafka.partitioner.KafkaPartitioner<IN> customPartitioner) The main constructor for creating a FlinkKafkaProducer.
FlinkKafkaProducer08(String brokerList, String topicId, org.apache.flink.streaming.util.serialization.KeyedSerializationSchema<IN> serializationSchema) Creates a FlinkKafkaProducer for a given topic.
FlinkKafkaProducer08(String brokerList, String topicId, org.apache.flink.streaming.util.serialization.SerializationSchema<IN> serializationSchema) Creates a FlinkKafkaProducer for a given topic.

Method Summary

Methods inherited from class org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase

checkErroneous, close, getPropertiesFromBrokerList, invoke, open, setLogFailuresOnly

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkKafkaProducer08

public FlinkKafkaProducer08(String brokerList,
                            String topicId,
                            org.apache.flink.streaming.util.serialization.SerializationSchema<IN> serializationSchema)

Creates a FlinkKafkaProducer for a given topic. The sink produces its input to the topic.

Parameters:

brokerList - Comma separated addresses of the brokers

topicId - ID of the Kafka topic.

serializationSchema - User defined (keyless) serialization schema.

FlinkKafkaProducer08

public FlinkKafkaProducer08(String topicId,
                            org.apache.flink.streaming.util.serialization.SerializationSchema<IN> serializationSchema,
                            Properties producerConfig)

Creates a FlinkKafkaProducer for a given topic. The sink produces its input to the topic.

Parameters:

topicId - ID of the Kafka topic.

serializationSchema - User defined (keyless) serialization schema.

producerConfig - Properties with the producer configuration.

FlinkKafkaProducer08

public FlinkKafkaProducer08(String topicId,
                            org.apache.flink.streaming.util.serialization.SerializationSchema<IN> serializationSchema,
                            Properties producerConfig,
                            org.apache.flink.streaming.connectors.kafka.partitioner.KafkaPartitioner<IN> customPartitioner)

The main constructor for creating a FlinkKafkaProducer.

Parameters:

topicId - The topic to write data to

serializationSchema - A (keyless) serializable serialization schema for turning user objects into a kafka-consumable byte[]

producerConfig - Configuration properties for the KafkaProducer. 'bootstrap.servers.' is the only required argument.

customPartitioner - A serializable partitioner for assining messages to Kafka partitions.

FlinkKafkaProducer08

public FlinkKafkaProducer08(String brokerList,
                            String topicId,
                            org.apache.flink.streaming.util.serialization.KeyedSerializationSchema<IN> serializationSchema)

Creates a FlinkKafkaProducer for a given topic. The sink produces its input to the topic.

Parameters:

brokerList - Comma separated addresses of the brokers

topicId - ID of the Kafka topic.

serializationSchema - User defined serialization schema supporting key/value messages

FlinkKafkaProducer08

public FlinkKafkaProducer08(String topicId,
                            org.apache.flink.streaming.util.serialization.KeyedSerializationSchema<IN> serializationSchema,
                            Properties producerConfig)

Creates a FlinkKafkaProducer for a given topic. The sink produces its input to the topic.

Parameters:

topicId - ID of the Kafka topic.

serializationSchema - User defined serialization schema supporting key/value messages

producerConfig - Properties with the producer configuration.

FlinkKafkaProducer08

public FlinkKafkaProducer08(String topicId,
                            org.apache.flink.streaming.util.serialization.KeyedSerializationSchema<IN> serializationSchema,
                            Properties producerConfig,
                            org.apache.flink.streaming.connectors.kafka.partitioner.KafkaPartitioner<IN> customPartitioner)

The main constructor for creating a FlinkKafkaProducer.

Parameters:

topicId - The topic to write data to

serializationSchema - A serializable serialization schema for turning user objects into a kafka-consumable byte[] supporting key/value messages

producerConfig - Configuration properties for the KafkaProducer. 'bootstrap.servers.' is the only required argument.

customPartitioner - A serializable partitioner for assining messages to Kafka partitions.