org.apache.flink.streaming.connectors.pulsar.internal

Class PulsarDeserializer

java.lang.Object

org.apache.flink.streaming.connectors.pulsar.internal.PulsarDeserializer

All Implemented Interfaces:

Serializable, org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.types.Row>, PulsarContextAware<org.apache.flink.types.Row>, PulsarDeserializationSchema<org.apache.flink.types.Row>

public class PulsarDeserializer
extends Object
implements PulsarDeserializationSchema<org.apache.flink.types.Row>

Deserialize Pulsar message into Flink row.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	PulsarDeserializer.ArrayDataUpdater Flink array field updater.
static interface	PulsarDeserializer.BinFunction<A,B> Binary function interface that takes three arguments and returns nothing.
static interface	PulsarDeserializer.Function<T,R> Represents a function that accepts one argument and produces a result.
static class	PulsarDeserializer.NewDecimalConversion DecimalConversion.
static class	PulsarDeserializer.RowUpdater Flink Row field updater.
static interface	PulsarDeserializer.TriFunction<A,B,C> Trinary function interface that takes three arguments and returns nothing.

Constructor Summary

Constructors

Constructor and Description
PulsarDeserializer(org.apache.pulsar.common.schema.SchemaInfo schemaInfo, JSONOptions parsedOptions, boolean useExtendField)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.types.Row	deserialize(org.apache.pulsar.client.api.Message message) Deserializes the Pulsar message.
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.types.Row>	getProducedType()
org.apache.pulsar.client.api.Schema<org.apache.flink.types.Row>	getSchema()
boolean	isEndOfStream(org.apache.flink.types.Row nextElement) Method to decide whether the element signals the end of the stream.
void	open(org.apache.flink.api.common.serialization.DeserializationSchema.InitializationContext context)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.util.serialization.PulsarDeserializationSchema

builder, deserialize, valueOnly

Methods inherited from interface org.apache.flink.streaming.util.serialization.PulsarContextAware

getTargetTopic, setNumParallelInstances, setParallelInstanceId

Constructor Detail

PulsarDeserializer

public PulsarDeserializer(org.apache.pulsar.common.schema.SchemaInfo schemaInfo,
                          JSONOptions parsedOptions,
                          boolean useExtendField)

Method Detail

open

public void open(org.apache.flink.api.common.serialization.DeserializationSchema.InitializationContext context)
          throws Exception

Specified by:

open in interface PulsarDeserializationSchema<org.apache.flink.types.Row>

Throws:

Exception

isEndOfStream

public boolean isEndOfStream(org.apache.flink.types.Row nextElement)

Description copied from interface: PulsarDeserializationSchema

Method to decide whether the element signals the end of the stream. If true is returned the element won't be emitted.

Specified by:

isEndOfStream in interface PulsarDeserializationSchema<org.apache.flink.types.Row>

Parameters:

nextElement - The element to test for the end-of-stream signal.

Returns:

True, if the element signals end of stream, false otherwise.

deserialize

public org.apache.flink.types.Row deserialize(org.apache.pulsar.client.api.Message message)
                                       throws IOException

Description copied from interface: PulsarDeserializationSchema

Deserializes the Pulsar message.

Can output multiple records through the Collector. Note that number and size of the produced records should be relatively small. Depending on the source implementation records can be buffered in memory or collecting records might delay emitting checkpoint barrier.

Specified by:

deserialize in interface PulsarDeserializationSchema<org.apache.flink.types.Row>

Parameters:

message - The message, as a byte array.

Throws:

IOException

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.types.Row> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<org.apache.flink.types.Row>

getSchema

public org.apache.pulsar.client.api.Schema<org.apache.flink.types.Row> getSchema()

Specified by:

getSchema in interface PulsarContextAware<org.apache.flink.types.Row>