org.apache.hudi.util

Class FlinkWriteClients

java.lang.Object

org.apache.hudi.util.FlinkWriteClients

public class FlinkWriteClients
extends Object

Utilities for HoodieFlinkWriteClient.

Constructor Summary

Constructors

Constructor and Description
FlinkWriteClients()

Method Summary

Modifier and Type	Method and Description
static HoodieFlinkWriteClient	createWriteClient(org.apache.flink.configuration.Configuration conf) Creates the Flink write client.
static HoodieFlinkWriteClient	createWriteClient(org.apache.flink.configuration.Configuration conf, org.apache.flink.api.common.functions.RuntimeContext runtimeContext) Creates the Flink write client.
static HoodieFlinkWriteClient	createWriteClient(org.apache.flink.configuration.Configuration conf, org.apache.flink.api.common.functions.RuntimeContext runtimeContext, boolean loadFsViewStorageConfig) Creates the Flink write client.
static HoodieFlinkWriteClient	createWriteClientV2(org.apache.flink.configuration.Configuration conf) Creates the Flink write client.
static HoodieWriteConfig	getHoodieClientConfig(org.apache.flink.configuration.Configuration conf) Mainly used for tests.
static HoodieWriteConfig	getHoodieClientConfig(org.apache.flink.configuration.Configuration conf, boolean loadFsViewStorageConfig)
static HoodieWriteConfig	getHoodieClientConfig(org.apache.flink.configuration.Configuration conf, boolean enableEmbeddedTimelineService, boolean loadFsViewStorageConfig)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkWriteClients

public FlinkWriteClients()

Method Detail

createWriteClient

public static HoodieFlinkWriteClient createWriteClient(org.apache.flink.configuration.Configuration conf)
                                                throws IOException

Creates the Flink write client.

This expects to be used by the driver, the client can then send requests for files view.

The task context supplier is a constant: the write token is always '0-1-0'.

Throws:

IOException

createWriteClientV2

public static HoodieFlinkWriteClient createWriteClientV2(org.apache.flink.configuration.Configuration conf)

Creates the Flink write client.

This expects to be used by the driver, the client can then send requests for files view.

The task context supplier is a constant: the write token is always '0-1-0'.

Note: different with createWriteClient(org.apache.flink.configuration.Configuration), the fs view storage options are set into the given configuration conf.

createWriteClient

public static HoodieFlinkWriteClient createWriteClient(org.apache.flink.configuration.Configuration conf,
                                                       org.apache.flink.api.common.functions.RuntimeContext runtimeContext)

Creates the Flink write client.

This expects to be used by client, the driver should start an embedded timeline server.

createWriteClient

public static HoodieFlinkWriteClient createWriteClient(org.apache.flink.configuration.Configuration conf,
                                                       org.apache.flink.api.common.functions.RuntimeContext runtimeContext,
                                                       boolean loadFsViewStorageConfig)

Creates the Flink write client.

This expects to be used by client, set flag loadFsViewStorageConfig to use remote filesystem view storage config, or an in-memory filesystem view storage is used.

getHoodieClientConfig

public static HoodieWriteConfig getHoodieClientConfig(org.apache.flink.configuration.Configuration conf)

Mainly used for tests.

getHoodieClientConfig

public static HoodieWriteConfig getHoodieClientConfig(org.apache.flink.configuration.Configuration conf,
                                                      boolean loadFsViewStorageConfig)

getHoodieClientConfig

public static HoodieWriteConfig getHoodieClientConfig(org.apache.flink.configuration.Configuration conf,
                                                      boolean enableEmbeddedTimelineService,
                                                      boolean loadFsViewStorageConfig)