org.apache.flink.table.filesystem

类 FileSystemTableSink

java.lang.Object

org.apache.flink.table.filesystem.FileSystemTableSink

所有已实现的接口:

org.apache.flink.table.sinks.AppendStreamTableSink<org.apache.flink.table.data.RowData>, org.apache.flink.table.sinks.OverwritableTableSink, org.apache.flink.table.sinks.PartitionableTableSink, org.apache.flink.table.sinks.StreamTableSink<org.apache.flink.table.data.RowData>, org.apache.flink.table.sinks.TableSink<org.apache.flink.table.data.RowData>

public class FileSystemTableSink
extends Object
implements org.apache.flink.table.sinks.AppendStreamTableSink<org.apache.flink.table.data.RowData>, org.apache.flink.table.sinks.PartitionableTableSink, org.apache.flink.table.sinks.OverwritableTableSink

File system TableSink.

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	FileSystemTableSink.ProjectionBulkFactory Project row to non-partition fields.
static class	FileSystemTableSink.TableBucketAssigner Table bucket assigner, wrap PartitionComputer.
static class	FileSystemTableSink.TableRollingPolicy Table RollingPolicy, it extends CheckpointRollingPolicy for bulk writers.

构造器概要

构造器

构造器和说明
FileSystemTableSink(org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier, boolean isBounded, org.apache.flink.table.api.TableSchema schema, org.apache.flink.core.fs.Path path, List<String> partitionKeys, String defaultPartName, Map<String,String> properties) Construct a file system table sink.

方法概要

限定符和类型	方法和说明
FileSystemTableSink	configure(String[] fieldNames, org.apache.flink.api.common.typeinfo.TypeInformation<?>[] fieldTypes)
boolean	configurePartitionGrouping(boolean supportsGrouping)
org.apache.flink.streaming.api.datastream.DataStreamSink<org.apache.flink.table.data.RowData>	consumeDataStream(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> dataStream)
static org.apache.flink.streaming.api.datastream.DataStreamSink<org.apache.flink.table.data.RowData>	createStreamingSink(org.apache.flink.configuration.Configuration conf, org.apache.flink.core.fs.Path path, List<String> partitionKeys, org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier, boolean overwrite, org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> inputStream, org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<org.apache.flink.table.data.RowData,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<org.apache.flink.table.data.RowData,?,?>> bucketsBuilder, TableMetaStoreFactory msFactory, FileSystemFactory fsFactory, long rollingCheckInterval)
org.apache.flink.table.types.DataType	getConsumedDataType()
org.apache.flink.table.api.TableSchema	getTableSchema()
void	setOverwrite(boolean overwrite)
void	setStaticPartition(Map<String,String> partitions)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.table.sinks.TableSink

getFieldNames, getFieldTypes, getOutputType

构造器详细资料

FileSystemTableSink

public FileSystemTableSink(org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier,
                           boolean isBounded,
                           org.apache.flink.table.api.TableSchema schema,
                           org.apache.flink.core.fs.Path path,
                           List<String> partitionKeys,
                           String defaultPartName,
                           Map<String,String> properties)

Construct a file system table sink.

参数:

isBounded - whether the input of sink is bounded.

schema - schema of the table.

path - directory path of the file system table.

partitionKeys - partition keys of the table.

defaultPartName - The default partition name in case the dynamic partition column value is null/empty string.

properties - properties.

方法详细资料

consumeDataStream

public final org.apache.flink.streaming.api.datastream.DataStreamSink<org.apache.flink.table.data.RowData> consumeDataStream(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> dataStream)

指定者:

consumeDataStream 在接口中 org.apache.flink.table.sinks.StreamTableSink<org.apache.flink.table.data.RowData>

createStreamingSink

public static org.apache.flink.streaming.api.datastream.DataStreamSink<org.apache.flink.table.data.RowData> createStreamingSink(org.apache.flink.configuration.Configuration conf,
                                                                                                                                org.apache.flink.core.fs.Path path,
                                                                                                                                List<String> partitionKeys,
                                                                                                                                org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier,
                                                                                                                                boolean overwrite,
                                                                                                                                org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> inputStream,
                                                                                                                                org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<org.apache.flink.table.data.RowData,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<org.apache.flink.table.data.RowData,?,?>> bucketsBuilder,
                                                                                                                                TableMetaStoreFactory msFactory,
                                                                                                                                FileSystemFactory fsFactory,
                                                                                                                                long rollingCheckInterval)

configure

public FileSystemTableSink configure(String[] fieldNames,
                                     org.apache.flink.api.common.typeinfo.TypeInformation<?>[] fieldTypes)

指定者:

configure 在接口中 org.apache.flink.table.sinks.TableSink<org.apache.flink.table.data.RowData>

setOverwrite

public void setOverwrite(boolean overwrite)

指定者:

setOverwrite 在接口中 org.apache.flink.table.sinks.OverwritableTableSink

setStaticPartition

public void setStaticPartition(Map<String,String> partitions)

指定者:

setStaticPartition 在接口中 org.apache.flink.table.sinks.PartitionableTableSink

getTableSchema

public org.apache.flink.table.api.TableSchema getTableSchema()

指定者:

getTableSchema 在接口中 org.apache.flink.table.sinks.TableSink<org.apache.flink.table.data.RowData>

getConsumedDataType

public org.apache.flink.table.types.DataType getConsumedDataType()

指定者:

getConsumedDataType 在接口中 org.apache.flink.table.sinks.TableSink<org.apache.flink.table.data.RowData>

configurePartitionGrouping

public boolean configurePartitionGrouping(boolean supportsGrouping)

指定者:

configurePartitionGrouping 在接口中 org.apache.flink.table.sinks.PartitionableTableSink