org.apache.flink.streaming.connectors.kafka

Class Kafka09AvroTableSource

java.lang.Object

org.apache.flink.streaming.connectors.kafka.KafkaTableSource

org.apache.flink.streaming.connectors.kafka.KafkaAvroTableSource

org.apache.flink.streaming.connectors.kafka.Kafka09AvroTableSource

All Implemented Interfaces:

org.apache.flink.table.sources.DefinedFieldMapping, org.apache.flink.table.sources.DefinedProctimeAttribute, org.apache.flink.table.sources.DefinedRowtimeAttributes, org.apache.flink.table.sources.StreamTableSource<org.apache.flink.types.Row>, org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row>

public class Kafka09AvroTableSource
extends org.apache.flink.streaming.connectors.kafka.KafkaAvroTableSource

Kafka StreamTableSource for Kafka 0.9.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Kafka09AvroTableSource.Builder A builder to configure and create a Kafka09AvroTableSource.

Constructor Summary

Constructors

Constructor and Description
Kafka09AvroTableSource(String topic, Properties properties, org.apache.flink.table.api.TableSchema schema, Class<? extends org.apache.avro.specific.SpecificRecordBase> record) Creates a Kafka 0.9 Avro StreamTableSource using a given SpecificRecord.

Method Summary

Modifier and Type	Method and Description
static Kafka09AvroTableSource.Builder	builder() Returns a builder to configure and create a Kafka09AvroTableSource.
protected org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase<org.apache.flink.types.Row>	createKafkaConsumer(String topic, Properties properties, org.apache.flink.api.common.serialization.DeserializationSchema<org.apache.flink.types.Row> deserializationSchema)
void	setFieldMapping(Map<String,String> fieldMapping) Sets a mapping from schema fields to fields of the produced Avro record.
void	setProctimeAttribute(String proctimeAttribute) Declares a field of the schema to be a processing time attribute.
void	setRowtimeAttributeDescriptor(org.apache.flink.table.sources.RowtimeAttributeDescriptor rowtimeAttributeDescriptor) Declares a field of the schema to be a rowtime attribute.

Methods inherited from class org.apache.flink.streaming.connectors.kafka.KafkaAvroTableSource

explainSource, getDeserializationSchema, getFieldMapping

Methods inherited from class org.apache.flink.streaming.connectors.kafka.KafkaTableSource

getDataStream, getKafkaConsumer, getProctimeAttribute, getReturnType, getRowtimeAttributeDescriptors, getTableSchema, setRowtimeAttributeDescriptors, setSpecificStartupOffsets, setStartupMode

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Kafka09AvroTableSource

public Kafka09AvroTableSource(String topic,
                              Properties properties,
                              org.apache.flink.table.api.TableSchema schema,
                              Class<? extends org.apache.avro.specific.SpecificRecordBase> record)

Creates a Kafka 0.9 Avro StreamTableSource using a given SpecificRecord.

Parameters:

topic - Kafka topic to consume.

properties - Properties for the Kafka consumer.

schema - Schema of the produced table.

record - Avro specific record.

Method Detail

setFieldMapping

public void setFieldMapping(Map<String,String> fieldMapping)

Sets a mapping from schema fields to fields of the produced Avro record.

A field mapping is required if the fields of produced tables should be named different than the fields of the Avro record. The key of the provided Map refers to the field of the table schema, the value to the field of the Avro record.

Overrides:

setFieldMapping in class org.apache.flink.streaming.connectors.kafka.KafkaAvroTableSource

Parameters:

fieldMapping - A mapping from schema fields to Avro fields.

setProctimeAttribute

public void setProctimeAttribute(String proctimeAttribute)

Declares a field of the schema to be a processing time attribute.

Overrides:

setProctimeAttribute in class org.apache.flink.streaming.connectors.kafka.KafkaTableSource

Parameters:

proctimeAttribute - The name of the field that becomes the processing time field.

setRowtimeAttributeDescriptor

public void setRowtimeAttributeDescriptor(org.apache.flink.table.sources.RowtimeAttributeDescriptor rowtimeAttributeDescriptor)

Declares a field of the schema to be a rowtime attribute.

Parameters:

rowtimeAttributeDescriptor - The descriptor of the rowtime attribute.

createKafkaConsumer

protected org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase<org.apache.flink.types.Row> createKafkaConsumer(String topic,
                                                                                                                             Properties properties,
                                                                                                                             org.apache.flink.api.common.serialization.DeserializationSchema<org.apache.flink.types.Row> deserializationSchema)

Specified by:

createKafkaConsumer in class org.apache.flink.streaming.connectors.kafka.KafkaTableSource

builder

public static Kafka09AvroTableSource.Builder builder()

Returns a builder to configure and create a Kafka09AvroTableSource.

Returns:

A builder to configure and create a Kafka09AvroTableSource.