cn.tenmg.cdc.log.connectors.base.utils

类 SourceRecordUtils

java.lang.Object

cn.tenmg.cdc.log.connectors.base.utils.SourceRecordUtils

public class SourceRecordUtils
extends Object

Utility class to deal record.

字段概要

字段

限定符和类型	字段和说明
static String	SCHEMA_CHANGE_EVENT_KEY_NAME

方法概要

限定符和类型	方法和说明
static Long	getFetchTimestamp(org.apache.kafka.connect.source.SourceRecord record) The field `ts_ms` in SourceRecord data struct is the time when the record fetched by debezium reader, use it as the process time in Source.
static io.debezium.relational.history.HistoryRecord	getHistoryRecord(org.apache.kafka.connect.source.SourceRecord schemaRecord)
static Long	getMessageTimestamp(org.apache.kafka.connect.source.SourceRecord record) Return the timestamp when the change event is produced in MySQL.
static Object[]	getSplitKey(org.apache.flink.table.types.logical.RowType splitBoundaryType, org.apache.kafka.connect.source.SourceRecord dataRecord, io.debezium.util.SchemaNameAdjuster nameAdjuster)
static io.debezium.relational.TableId	getTableId(org.apache.kafka.connect.source.SourceRecord dataRecord)
static boolean	isDataChangeRecord(org.apache.kafka.connect.source.SourceRecord record)
static boolean	isEndWatermarkEvent(org.apache.kafka.connect.source.SourceRecord record)
static boolean	isHighWatermarkEvent(org.apache.kafka.connect.source.SourceRecord record)
static boolean	isLowWatermarkEvent(org.apache.kafka.connect.source.SourceRecord record)
static boolean	isSchemaChangeEvent(org.apache.kafka.connect.source.SourceRecord sourceRecord)
static boolean	isWatermarkEvent(org.apache.kafka.connect.source.SourceRecord record)
static List<org.apache.kafka.connect.source.SourceRecord>	normalizedSplitRecords(SnapshotSplit snapshotSplit, List<org.apache.kafka.connect.source.SourceRecord> sourceRecords, io.debezium.util.SchemaNameAdjuster nameAdjuster) Normalize the records of snapshot split which represents the split records state on high watermark. data input: [low watermark event] [snapshot events ] [high watermark event] [binlog events] [binlog-end event] data output: [low watermark event] [normalized events] [high watermark event]
static Object[]	rowToArray(ResultSet rs, int size) Converts a ResultSet row to an array of Objects.
static boolean	splitKeyRangeContains(Object[] key, Object[] splitKeyStart, Object[] splitKeyEnd) Returns the specific key contains in the split key range or not.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

SCHEMA_CHANGE_EVENT_KEY_NAME

public static final String SCHEMA_CHANGE_EVENT_KEY_NAME

另请参阅:

常量字段值

方法详细资料

rowToArray

public static Object[] rowToArray(ResultSet rs,
                                  int size)
                           throws SQLException

Converts a ResultSet row to an array of Objects.

抛出:

SQLException

isWatermarkEvent

public static boolean isWatermarkEvent(org.apache.kafka.connect.source.SourceRecord record)

isLowWatermarkEvent

public static boolean isLowWatermarkEvent(org.apache.kafka.connect.source.SourceRecord record)

isHighWatermarkEvent

public static boolean isHighWatermarkEvent(org.apache.kafka.connect.source.SourceRecord record)

isEndWatermarkEvent

public static boolean isEndWatermarkEvent(org.apache.kafka.connect.source.SourceRecord record)

getMessageTimestamp

public static Long getMessageTimestamp(org.apache.kafka.connect.source.SourceRecord record)

Return the timestamp when the change event is produced in MySQL.

The field `source.ts_ms` in SourceRecord data struct is the time when the change event is operated in MySQL.

getFetchTimestamp

public static Long getFetchTimestamp(org.apache.kafka.connect.source.SourceRecord record)

The field `ts_ms` in SourceRecord data struct is the time when the record fetched by debezium reader, use it as the process time in Source.

isSchemaChangeEvent

public static boolean isSchemaChangeEvent(org.apache.kafka.connect.source.SourceRecord sourceRecord)

isDataChangeRecord

public static boolean isDataChangeRecord(org.apache.kafka.connect.source.SourceRecord record)

getTableId

public static io.debezium.relational.TableId getTableId(org.apache.kafka.connect.source.SourceRecord dataRecord)

getSplitKey

public static Object[] getSplitKey(org.apache.flink.table.types.logical.RowType splitBoundaryType,
                                   org.apache.kafka.connect.source.SourceRecord dataRecord,
                                   io.debezium.util.SchemaNameAdjuster nameAdjuster)

splitKeyRangeContains

public static boolean splitKeyRangeContains(Object[] key,
                                            Object[] splitKeyStart,
                                            Object[] splitKeyEnd)

Returns the specific key contains in the split key range or not.

getHistoryRecord

public static io.debezium.relational.history.HistoryRecord getHistoryRecord(org.apache.kafka.connect.source.SourceRecord schemaRecord)
                                                                     throws IOException

抛出:

IOException

normalizedSplitRecords

public static List<org.apache.kafka.connect.source.SourceRecord> normalizedSplitRecords(SnapshotSplit snapshotSplit,
                                                                                        List<org.apache.kafka.connect.source.SourceRecord> sourceRecords,
                                                                                        io.debezium.util.SchemaNameAdjuster nameAdjuster)

Normalize the records of snapshot split which represents the split records state on high watermark. data input: [low watermark event] [snapshot events ] [high watermark event] [binlog events] [binlog-end event] data output: [low watermark event] [normalized events] [high watermark event]