org.apache.hudi.gcp.bigquery

Class BigQuerySyncConfig

java.lang.Object

org.apache.hudi.common.config.HoodieConfig

org.apache.hudi.sync.common.HoodieSyncConfig

org.apache.hudi.gcp.bigquery.BigQuerySyncConfig

All Implemented Interfaces:

Serializable

@Immutable
public class BigQuerySyncConfig
extends HoodieSyncConfig
implements Serializable

Configs needed to sync data into BigQuery.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BigQuerySyncConfig.BigQuerySyncConfigParams

Nested classes/interfaces inherited from class org.apache.hudi.sync.common.HoodieSyncConfig

HoodieSyncConfig.HoodieSyncConfigParams

Field Summary

Fields

Modifier and Type	Field and Description
static ConfigProperty<String>	BIGQUERY_SYNC_ASSUME_DATE_PARTITIONING
static ConfigProperty<String>	BIGQUERY_SYNC_BIG_LAKE_CONNECTION_ID
static ConfigProperty<String>	BIGQUERY_SYNC_DATASET_LOCATION
static ConfigProperty<String>	BIGQUERY_SYNC_DATASET_NAME
static ConfigProperty<String>	BIGQUERY_SYNC_PARTITION_FIELDS
static ConfigProperty<String>	BIGQUERY_SYNC_PROJECT_ID
static ConfigProperty<Boolean>	BIGQUERY_SYNC_REQUIRE_PARTITION_FILTER
static ConfigProperty<String>	BIGQUERY_SYNC_SOURCE_URI
static ConfigProperty<String>	BIGQUERY_SYNC_SOURCE_URI_PREFIX
static ConfigProperty<String>	BIGQUERY_SYNC_SYNC_BASE_PATH
static ConfigProperty<String>	BIGQUERY_SYNC_TABLE_NAME
static ConfigProperty<Boolean>	BIGQUERY_SYNC_USE_BQ_MANIFEST_FILE
static ConfigProperty<Boolean>	BIGQUERY_SYNC_USE_FILE_LISTING_FROM_METADATA

Fields inherited from class org.apache.hudi.sync.common.HoodieSyncConfig

META_SYNC_ASSUME_DATE_PARTITION, META_SYNC_BASE_FILE_FORMAT, META_SYNC_BASE_PATH, META_SYNC_CONDITIONAL_SYNC, META_SYNC_DATABASE_NAME, META_SYNC_DECODE_PARTITION, META_SYNC_ENABLED, META_SYNC_INCREMENTAL, META_SYNC_PARTITION_EXTRACTOR_CLASS, META_SYNC_PARTITION_FIELDS, META_SYNC_SNAPSHOT_WITH_TABLE_NAME, META_SYNC_SPARK_VERSION, META_SYNC_TABLE_NAME, META_SYNC_USE_FILE_LISTING_FROM_METADATA

Fields inherited from class org.apache.hudi.common.config.HoodieConfig

CONFIG_VALUES_DELIMITER, props

Constructor Summary

Constructors

Constructor and Description
BigQuerySyncConfig(Properties props)

Method Summary

Methods inherited from class org.apache.hudi.sync.common.HoodieSyncConfig

getAbsoluteBasePath, getHadoopConf, getHadoopFileSystem, setHadoopConf, toString

Methods inherited from class org.apache.hudi.common.config.HoodieConfig

contains, contains, getBoolean, getBooleanOrDefault, getBooleanOrDefault, getBooleanOrDefault, getDouble, getDoubleOrDefault, getFloat, getFloatOrDefault, getInt, getIntOrDefault, getLong, getLongOrDefault, getProps, getProps, getSplitStrings, getSplitStrings, getString, getString, getStringOrDefault, getStringOrDefault, getStringOrThrow, setAll, setDefault, setDefaultOnCondition, setDefaults, setDefaultValue, setDefaultValue, setValue, setValue

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

BIGQUERY_SYNC_PROJECT_ID

public static final ConfigProperty<String> BIGQUERY_SYNC_PROJECT_ID

BIGQUERY_SYNC_DATASET_NAME

public static final ConfigProperty<String> BIGQUERY_SYNC_DATASET_NAME

BIGQUERY_SYNC_DATASET_LOCATION

public static final ConfigProperty<String> BIGQUERY_SYNC_DATASET_LOCATION

BIGQUERY_SYNC_TABLE_NAME

public static final ConfigProperty<String> BIGQUERY_SYNC_TABLE_NAME

BIGQUERY_SYNC_USE_BQ_MANIFEST_FILE

public static final ConfigProperty<Boolean> BIGQUERY_SYNC_USE_BQ_MANIFEST_FILE

BIGQUERY_SYNC_SOURCE_URI

public static final ConfigProperty<String> BIGQUERY_SYNC_SOURCE_URI

BIGQUERY_SYNC_SOURCE_URI_PREFIX

public static final ConfigProperty<String> BIGQUERY_SYNC_SOURCE_URI_PREFIX

BIGQUERY_SYNC_SYNC_BASE_PATH

public static final ConfigProperty<String> BIGQUERY_SYNC_SYNC_BASE_PATH

BIGQUERY_SYNC_PARTITION_FIELDS

public static final ConfigProperty<String> BIGQUERY_SYNC_PARTITION_FIELDS

BIGQUERY_SYNC_USE_FILE_LISTING_FROM_METADATA

public static final ConfigProperty<Boolean> BIGQUERY_SYNC_USE_FILE_LISTING_FROM_METADATA

BIGQUERY_SYNC_ASSUME_DATE_PARTITIONING

public static final ConfigProperty<String> BIGQUERY_SYNC_ASSUME_DATE_PARTITIONING

BIGQUERY_SYNC_REQUIRE_PARTITION_FILTER

public static final ConfigProperty<Boolean> BIGQUERY_SYNC_REQUIRE_PARTITION_FILTER

BIGQUERY_SYNC_BIG_LAKE_CONNECTION_ID

public static final ConfigProperty<String> BIGQUERY_SYNC_BIG_LAKE_CONNECTION_ID

Constructor Detail

BigQuerySyncConfig

public BigQuerySyncConfig(Properties props)