org.apache.beam.sdk.extensions.sql.meta.provider.pubsub

Class RowToPubsubMessage

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage>>

org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.RowToPubsubMessage

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

@Experimental
public class RowToPubsubMessage
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage>>

A PTransform to convert Row to PubsubMessage with JSON payload.

Currently only supports writing a flat schema into a JSON payload. This means that all Row field values are written to the PubsubMessage JSON payload, except for event_timestamp, which is either ignored or written to the message attributes, depending on whether PubsubJsonTableProvider.PubsubIOTableConfiguration.getTimestampAttribute() is set.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage>	expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input)
static RowToPubsubMessage	fromTableConfig(PubsubJsonTableProvider.PubsubIOTableConfiguration config)

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, populateDisplayData, toString, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

fromTableConfig

public static RowToPubsubMessage fromTableConfig(PubsubJsonTableProvider.PubsubIOTableConfiguration config)

expand

public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage> expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.io.gcp.pubsub.PubsubMessage>>