org.apache.hudi.gcp.bigquery

Class BigQuerySyncTool

java.lang.Object

org.apache.hudi.sync.common.HoodieSyncTool

org.apache.hudi.gcp.bigquery.BigQuerySyncTool

All Implemented Interfaces:

AutoCloseable

public class BigQuerySyncTool
extends HoodieSyncTool

Tool to sync a hoodie table with a big query table. Either use it as an api BigQuerySyncTool.syncHoodieTable(BigQuerySyncConfig) or as a command line java -cp hoodie-hive.jar BigQuerySyncTool [args]

This utility will get the schema from the latest commit and will sync big query table schema.

Field Summary

Fields inherited from class org.apache.hudi.sync.common.HoodieSyncTool

hadoopConf, metrics, props

Constructor Summary

Constructors

Constructor and Description
BigQuerySyncTool(Properties props)
BigQuerySyncTool(Properties props, org.apache.hadoop.conf.Configuration configuration, Option<HoodieTableMetaClient> metaClientOption)

Method Summary

Modifier and Type	Method and Description
void	close()
static void	main(String[] args)
void	syncHoodieTable()

Methods inherited from class org.apache.hudi.sync.common.HoodieSyncTool

buildMetaClient

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BigQuerySyncTool

public BigQuerySyncTool(Properties props)

BigQuerySyncTool

public BigQuerySyncTool(Properties props,
                        org.apache.hadoop.conf.Configuration configuration,
                        Option<HoodieTableMetaClient> metaClientOption)

Method Detail

syncHoodieTable

public void syncHoodieTable()

Specified by:

syncHoodieTable in class HoodieSyncTool

close

public void close()
           throws Exception

Specified by:

close in interface AutoCloseable

Overrides:

close in class HoodieSyncTool

Throws:

Exception

main

public static void main(String[] args)