cn.tenmg.cdc.log.connectors.base.source.assigner.splitter

接口 JdbcSourceChunkSplitter

所有超级接口:

ChunkSplitter<io.debezium.relational.TableId>

@Experimental
public interface JdbcSourceChunkSplitter
extends ChunkSplitter<io.debezium.relational.TableId>

The ChunkSplitter used to split table into a set of chunks for JDBC data source.

方法概要

限定符和类型	方法和说明
String	buildSplitScanQuery(io.debezium.relational.TableId tableId, org.apache.flink.table.types.logical.RowType splitKeyType, boolean isFirstSplit, boolean isLastSplit) Build the scan query sql of the SnapshotSplit.
org.apache.flink.table.types.DataType	fromDbzColumn(io.debezium.relational.Column splitColumn) Get a corresponding Flink data type from a debezium Column.
Collection<SnapshotSplit>	generateSplits(io.debezium.relational.TableId tableId) Generates all snapshot splits (chunks) for the give table path.
default org.apache.flink.table.types.logical.RowType	getSplitType(io.debezium.relational.Column splitColumn) convert dbz column to Flink row type.
default boolean	isEvenlySplitColumn(io.debezium.relational.Column splitColumn) Checks whether split column is evenly distributed across its range.
Long	queryApproximateRowCnt(io.debezium.jdbc.JdbcConnection jdbc, io.debezium.relational.TableId tableId) Approximate total number of entries in the lookup table.
Object	queryMin(io.debezium.jdbc.JdbcConnection jdbc, io.debezium.relational.TableId tableId, String columnName, Object excludedLowerBound) Query the minimum value of the column in the table, and the minimum value must greater than the excludedLowerBound value. e.g. prepare query string SELECT MIN(%s) FROM %s WHERE %s > ?
Object[]	queryMinMax(io.debezium.jdbc.JdbcConnection jdbc, io.debezium.relational.TableId tableId, String columnName) Query the maximum and minimum value of the column in the table. e.g. query string SELECT MIN(%s) FROM %s WHERE %s > ?
Object	queryNextChunkMax(io.debezium.jdbc.JdbcConnection jdbc, io.debezium.relational.TableId tableId, String columnName, int chunkSize, Object includedLowerBound) Query the maximum value of the next chunk, and the next chunk must be greater than or equal to includedLowerBound value [min_1, max_1), [min_2, max_2),...

方法详细资料

generateSplits

Collection<SnapshotSplit> generateSplits(io.debezium.relational.TableId tableId)

Generates all snapshot splits (chunks) for the give table path.

指定者:

generateSplits 在接口中 ChunkSplitter<io.debezium.relational.TableId>

queryMinMax

Object[] queryMinMax(io.debezium.jdbc.JdbcConnection jdbc,
                     io.debezium.relational.TableId tableId,
                     String columnName)
              throws SQLException

Query the maximum and minimum value of the column in the table. e.g. query string SELECT MIN(%s) FROM %s WHERE %s > ?

参数:

jdbc - JDBC connection.

tableId - table identity.

columnName - column name.

返回:

maximum and minimum value.

抛出:

SQLException

queryMin

Object queryMin(io.debezium.jdbc.JdbcConnection jdbc,
                io.debezium.relational.TableId tableId,
                String columnName,
                Object excludedLowerBound)
         throws SQLException

Query the minimum value of the column in the table, and the minimum value must greater than the excludedLowerBound value. e.g. prepare query string SELECT MIN(%s) FROM %s WHERE %s > ?

参数:

jdbc - JDBC connection.

tableId - table identity.

columnName - column name.

excludedLowerBound - the minimum value should be greater than this value.

返回:

minimum value.

抛出:

SQLException

queryNextChunkMax

Object queryNextChunkMax(io.debezium.jdbc.JdbcConnection jdbc,
                         io.debezium.relational.TableId tableId,
                         String columnName,
                         int chunkSize,
                         Object includedLowerBound)
                  throws SQLException

Query the maximum value of the next chunk, and the next chunk must be greater than or equal to includedLowerBound value [min_1, max_1), [min_2, max_2),... [min_n, null). Each time this method is called it will return max1, max2...

参数:

jdbc - JDBC connection.

tableId - table identity.

columnName - column name.

chunkSize - chunk size.

includedLowerBound - the previous chunk end value.

返回:

next chunk end value.

抛出:

SQLException

queryApproximateRowCnt

Long queryApproximateRowCnt(io.debezium.jdbc.JdbcConnection jdbc,
                            io.debezium.relational.TableId tableId)
                     throws SQLException

Approximate total number of entries in the lookup table.

参数:

jdbc - JDBC connection.

tableId - table identity.

返回:

approximate row count.

抛出:

SQLException

buildSplitScanQuery

String buildSplitScanQuery(io.debezium.relational.TableId tableId,
                           org.apache.flink.table.types.logical.RowType splitKeyType,
                           boolean isFirstSplit,
                           boolean isLastSplit)

Build the scan query sql of the SnapshotSplit.

参数:

tableId - table identity.

splitKeyType - primary key type.

isFirstSplit - whether the first split.

isLastSplit - whether the last split.

返回:

query sql.

isEvenlySplitColumn

default boolean isEvenlySplitColumn(io.debezium.relational.Column splitColumn)

Checks whether split column is evenly distributed across its range.

参数:

splitColumn - split column.

返回:

true that means split column with type BIGINT, INT, DECIMAL.

fromDbzColumn

org.apache.flink.table.types.DataType fromDbzColumn(io.debezium.relational.Column splitColumn)

Get a corresponding Flink data type from a debezium Column.

参数:

splitColumn - dbz split column.

返回:

flink data type

getSplitType

default org.apache.flink.table.types.logical.RowType getSplitType(io.debezium.relational.Column splitColumn)

convert dbz column to Flink row type.

参数:

splitColumn - split column.

返回:

flink row type.