org.apache.flink.table.filesystem

Class FileSystemTableSource

java.lang.Object

org.apache.flink.table.filesystem.FileSystemTableSource

All Implemented Interfaces:

org.apache.flink.table.sources.FilterableTableSource<org.apache.flink.table.data.RowData>, org.apache.flink.table.sources.LimitableTableSource<org.apache.flink.table.data.RowData>, org.apache.flink.table.sources.PartitionableTableSource, org.apache.flink.table.sources.ProjectableTableSource<org.apache.flink.table.data.RowData>, org.apache.flink.table.sources.StreamTableSource<org.apache.flink.table.data.RowData>, org.apache.flink.table.sources.TableSource<org.apache.flink.table.data.RowData>

public class FileSystemTableSource
extends Object
implements org.apache.flink.table.sources.StreamTableSource<org.apache.flink.table.data.RowData>, org.apache.flink.table.sources.PartitionableTableSource, org.apache.flink.table.sources.ProjectableTableSource<org.apache.flink.table.data.RowData>, org.apache.flink.table.sources.LimitableTableSource<org.apache.flink.table.data.RowData>, org.apache.flink.table.sources.FilterableTableSource<org.apache.flink.table.data.RowData>

File system table source.

Constructor Summary

Constructors

Constructor and Description
FileSystemTableSource(org.apache.flink.table.api.TableSchema schema, org.apache.flink.core.fs.Path path, List<String> partitionKeys, String defaultPartName, Map<String,String> properties) Construct a file system table source.

Method Summary

Modifier and Type	Method and Description
FileSystemTableSource	applyLimit(long limit)
FileSystemTableSource	applyPartitionPruning(List<Map<String,String>> remainingPartitions)
FileSystemTableSource	applyPredicate(List<org.apache.flink.table.expressions.Expression> predicates)
String	explainSource()
org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData>	getDataStream(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment execEnv)
List<Map<String,String>>	getPartitions()
org.apache.flink.table.types.DataType	getProducedDataType()
org.apache.flink.table.api.TableSchema	getTableSchema()
boolean	isBounded()
boolean	isFilterPushedDown()
boolean	isLimitPushedDown()
FileSystemTableSource	projectFields(int[] fields)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.sources.TableSource

getReturnType

Constructor Detail

FileSystemTableSource

public FileSystemTableSource(org.apache.flink.table.api.TableSchema schema,
                             org.apache.flink.core.fs.Path path,
                             List<String> partitionKeys,
                             String defaultPartName,
                             Map<String,String> properties)

Construct a file system table source.

Parameters:

schema - schema of the table.

path - directory path of the file system table.

partitionKeys - partition keys of the table.

defaultPartName - The default partition name in case the dynamic partition column value is null/empty string.

properties - table properties.

Method Detail

getDataStream

public org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> getDataStream(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment execEnv)

Specified by:

getDataStream in interface org.apache.flink.table.sources.StreamTableSource<org.apache.flink.table.data.RowData>

isBounded

public boolean isBounded()

Specified by:

isBounded in interface org.apache.flink.table.sources.StreamTableSource<org.apache.flink.table.data.RowData>

getPartitions

public List<Map<String,String>> getPartitions()

Specified by:

getPartitions in interface org.apache.flink.table.sources.PartitionableTableSource

applyPartitionPruning

public FileSystemTableSource applyPartitionPruning(List<Map<String,String>> remainingPartitions)

Specified by:

applyPartitionPruning in interface org.apache.flink.table.sources.PartitionableTableSource

projectFields

public FileSystemTableSource projectFields(int[] fields)

Specified by:

projectFields in interface org.apache.flink.table.sources.ProjectableTableSource<org.apache.flink.table.data.RowData>

applyLimit

public FileSystemTableSource applyLimit(long limit)

Specified by:

applyLimit in interface org.apache.flink.table.sources.LimitableTableSource<org.apache.flink.table.data.RowData>

isLimitPushedDown

public boolean isLimitPushedDown()

Specified by:

isLimitPushedDown in interface org.apache.flink.table.sources.LimitableTableSource<org.apache.flink.table.data.RowData>

applyPredicate

public FileSystemTableSource applyPredicate(List<org.apache.flink.table.expressions.Expression> predicates)

Specified by:

applyPredicate in interface org.apache.flink.table.sources.FilterableTableSource<org.apache.flink.table.data.RowData>

isFilterPushedDown

public boolean isFilterPushedDown()

Specified by:

isFilterPushedDown in interface org.apache.flink.table.sources.FilterableTableSource<org.apache.flink.table.data.RowData>

getProducedDataType

public org.apache.flink.table.types.DataType getProducedDataType()

Specified by:

getProducedDataType in interface org.apache.flink.table.sources.TableSource<org.apache.flink.table.data.RowData>

getTableSchema

public org.apache.flink.table.api.TableSchema getTableSchema()

Specified by:

getTableSchema in interface org.apache.flink.table.sources.TableSource<org.apache.flink.table.data.RowData>

explainSource

public String explainSource()

Specified by:

explainSource in interface org.apache.flink.table.sources.TableSource<org.apache.flink.table.data.RowData>