org.apache.beam.sdk.io.fileschematransform

Interface FileWriteSchemaTransformFormatProvider

All Superinterfaces:

org.apache.beam.sdk.schemas.io.Providers.Identifyable

All Known Implementing Classes:

AvroWriteSchemaTransformFormatProvider, CsvWriteSchemaTransformFormatProvider, JsonWriteSchemaTransformFormatProvider, ParquetWriteSchemaTransformFormatProvider, XmlWriteSchemaTransformFormatProvider

@Internal
public interface FileWriteSchemaTransformFormatProvider
extends org.apache.beam.sdk.schemas.io.Providers.Identifyable

Provides a PTransform that writes a PCollection of Rows and outputs a PCollection of the file names according to a registered AutoService FileWriteSchemaTransformFormatProvider implementation. See FileWriteSchemaTransformFormatProviders for a list of available formats.

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollectionTuple>	buildTransform(FileWriteSchemaTransformConfiguration configuration, org.apache.beam.sdk.schemas.Schema schema) Builds a PTransform that writes a Row PCollection and outputs the resulting PCollectionTuple with two tags, one for the file names, and another errored-out rows.

Methods inherited from interface org.apache.beam.sdk.schemas.io.Providers.Identifyable

identifier

Method Detail

buildTransform

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollectionTuple> buildTransform(FileWriteSchemaTransformConfiguration configuration,
                                                                                                                                                                             org.apache.beam.sdk.schemas.Schema schema)

Builds a PTransform that writes a Row PCollection and outputs the resulting PCollectionTuple with two tags, one for the file names, and another errored-out rows.