org.apache.beam.sdk.io.fileschematransform

Class ParquetWriteSchemaTransformFormatProvider

java.lang.Object

org.apache.beam.sdk.io.fileschematransform.ParquetWriteSchemaTransformFormatProvider

All Implemented Interfaces:

FileWriteSchemaTransformFormatProvider, org.apache.beam.sdk.schemas.io.Providers.Identifyable

@AutoService(value=FileWriteSchemaTransformFormatProvider.class)
public class ParquetWriteSchemaTransformFormatProvider
extends java.lang.Object
implements FileWriteSchemaTransformFormatProvider

A FileWriteSchemaTransformFormatProvider for Parquet format.

Constructor Summary

Constructors

Constructor and Description
ParquetWriteSchemaTransformFormatProvider()

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollectionTuple>	buildTransform(FileWriteSchemaTransformConfiguration configuration, org.apache.beam.sdk.schemas.Schema schema) Builds a PTransform that transforms a Row PCollection into result PCollectionTuple with two tags, one for file names written using ParquetIO.Sink and FileIO.Write, another for errored-out rows.
java.lang.String	identifier()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetWriteSchemaTransformFormatProvider

public ParquetWriteSchemaTransformFormatProvider()

Method Detail

identifier

public java.lang.String identifier()

Specified by:

identifier in interface org.apache.beam.sdk.schemas.io.Providers.Identifyable

buildTransform

public org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,org.apache.beam.sdk.values.PCollectionTuple> buildTransform(FileWriteSchemaTransformConfiguration configuration,
                                                                                                                                                                                    org.apache.beam.sdk.schemas.Schema schema)

Builds a PTransform that transforms a Row PCollection into result PCollectionTuple with two tags, one for file names written using ParquetIO.Sink and FileIO.Write, another for errored-out rows.

Specified by:

buildTransform in interface FileWriteSchemaTransformFormatProvider