org.apache.hudi.gcp.bigquery

Class BigQuerySyncTool

java.lang.Object

org.apache.hudi.sync.common.HoodieSyncTool

org.apache.hudi.gcp.bigquery.BigQuerySyncTool

All Implemented Interfaces:

AutoCloseable

public class BigQuerySyncTool
extends HoodieSyncTool

Tool to sync a hoodie table with a big query table. Either use it as an api BigQuerySyncTool.syncHoodieTable(BigQuerySyncConfig) or as a command line java -cp hoodie-hive.jar BigQuerySyncTool [args]

This utility will get the schema from the latest commit and will sync big query table schema.

Field Summary

Fields

Modifier and Type	Field and Description
BigQuerySyncConfig	config
String	manifestTableName
String	snapshotViewName
String	tableName
String	versionsTableName

Fields inherited from class org.apache.hudi.sync.common.HoodieSyncTool

hadoopConf, props

Constructor Summary

Constructors

Constructor and Description
BigQuerySyncTool(Properties props)

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
void	syncHoodieTable()

Methods inherited from class org.apache.hudi.sync.common.HoodieSyncTool

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

config

public final BigQuerySyncConfig config

tableName

public final String tableName

manifestTableName

public final String manifestTableName

versionsTableName

public final String versionsTableName

snapshotViewName

public final String snapshotViewName

Constructor Detail

BigQuerySyncTool

public BigQuerySyncTool(Properties props)

Method Detail

syncHoodieTable

public void syncHoodieTable()

Specified by:

syncHoodieTable in class HoodieSyncTool

main

public static void main(String[] args)