org.apache.flink.fs.gs

Class GSFileSystemOptions

java.lang.Object

org.apache.flink.fs.gs.GSFileSystemOptions

public class GSFileSystemOptions
extends Object

The GS file system options.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.flink.configuration.ConfigOption<Boolean>	ENABLE_FILESINK_ENTROPY
static org.apache.flink.configuration.ConfigOption<Integer>	GCS_HTTP_CONNECT_TIMEOUT Flink config option to set the http connection timeout.
static org.apache.flink.configuration.ConfigOption<Integer>	GCS_HTTP_READ_TIMEOUT Flink config option to set the http read timeout.
static org.apache.flink.configuration.ConfigOption<Duration>	GCS_RETRY_INIT_RPC_TIMEOUT
static org.apache.flink.configuration.ConfigOption<Integer>	GCS_RETRY_MAX_ATTEMPT Flink config option to set the http read timeout.
static org.apache.flink.configuration.ConfigOption<Duration>	GCS_RETRY_MAX_RPC_TIMEOUT
static org.apache.flink.configuration.ConfigOption<Double>	GCS_RETRY_RPC_TIMEOUT_MULTIPLIER
static org.apache.flink.configuration.ConfigOption<Duration>	GCS_RETRY_TOTAL_TIMEOUT
static org.apache.flink.configuration.ConfigOption<org.apache.flink.configuration.MemorySize>	WRITER_CHUNK_SIZE
static org.apache.flink.configuration.ConfigOption<String>	WRITER_TEMPORARY_BUCKET_NAME

Constructor Summary

Constructors

Constructor and Description
GSFileSystemOptions(org.apache.flink.configuration.Configuration flinkConfig) Constructs an options instance.

Method Summary

Modifier and Type	Method and Description
Optional<Integer>	getHTTPConnectionTimeout() Timeout in millisecond to establish the connection.
Optional<Integer>	getHTTPReadTimeout() Timeout in millisecond to read content from connection.
Optional<org.threeten.bp.Duration>	getInitialRpcTimeout()
Optional<Integer>	getMaxAttempts()
Optional<org.threeten.bp.Duration>	getMaxRpcTimeout()
Optional<Double>	getRpcTimeoutMultiplier()
Optional<org.threeten.bp.Duration>	getTotalTimeout()
Optional<org.apache.flink.configuration.MemorySize>	getWriterChunkSize() The chunk size to use for writes on the underlying Google WriteChannel.
Optional<String>	getWriterTemporaryBucketName() The temporary bucket name to use for recoverable writes, if different from the final bucket name.
Boolean	isFileSinkEntropyEnabled() Whether entropy insertion is enabled in filesink path.
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

WRITER_TEMPORARY_BUCKET_NAME

public static final org.apache.flink.configuration.ConfigOption<String> WRITER_TEMPORARY_BUCKET_NAME

WRITER_CHUNK_SIZE

public static final org.apache.flink.configuration.ConfigOption<org.apache.flink.configuration.MemorySize> WRITER_CHUNK_SIZE

ENABLE_FILESINK_ENTROPY

public static final org.apache.flink.configuration.ConfigOption<Boolean> ENABLE_FILESINK_ENTROPY

GCS_HTTP_CONNECT_TIMEOUT

public static final org.apache.flink.configuration.ConfigOption<Integer> GCS_HTTP_CONNECT_TIMEOUT

Flink config option to set the http connection timeout. It will be used by cloud-storage library.

GCS_HTTP_READ_TIMEOUT

public static final org.apache.flink.configuration.ConfigOption<Integer> GCS_HTTP_READ_TIMEOUT

Flink config option to set the http read timeout. It will be used by cloud-storage library.

GCS_RETRY_MAX_ATTEMPT

public static final org.apache.flink.configuration.ConfigOption<Integer> GCS_RETRY_MAX_ATTEMPT

Flink config option to set the http read timeout. It will be used by cloud-storage library.

GCS_RETRY_INIT_RPC_TIMEOUT

public static final org.apache.flink.configuration.ConfigOption<Duration> GCS_RETRY_INIT_RPC_TIMEOUT

GCS_RETRY_RPC_TIMEOUT_MULTIPLIER

public static final org.apache.flink.configuration.ConfigOption<Double> GCS_RETRY_RPC_TIMEOUT_MULTIPLIER

GCS_RETRY_MAX_RPC_TIMEOUT

public static final org.apache.flink.configuration.ConfigOption<Duration> GCS_RETRY_MAX_RPC_TIMEOUT

GCS_RETRY_TOTAL_TIMEOUT

public static final org.apache.flink.configuration.ConfigOption<Duration> GCS_RETRY_TOTAL_TIMEOUT

Constructor Detail

GSFileSystemOptions

public GSFileSystemOptions(org.apache.flink.configuration.Configuration flinkConfig)

Constructs an options instance.

Parameters:

flinkConfig - The Flink configuration

Method Detail

getWriterTemporaryBucketName

public Optional<String> getWriterTemporaryBucketName()

The temporary bucket name to use for recoverable writes, if different from the final bucket name.

getHTTPConnectionTimeout

public Optional<Integer> getHTTPConnectionTimeout()

Timeout in millisecond to establish the connection.

getHTTPReadTimeout

public Optional<Integer> getHTTPReadTimeout()

Timeout in millisecond to read content from connection.

getMaxAttempts

public Optional<Integer> getMaxAttempts()

getInitialRpcTimeout

public Optional<org.threeten.bp.Duration> getInitialRpcTimeout()

getRpcTimeoutMultiplier

public Optional<Double> getRpcTimeoutMultiplier()

getMaxRpcTimeout

public Optional<org.threeten.bp.Duration> getMaxRpcTimeout()

getTotalTimeout

public Optional<org.threeten.bp.Duration> getTotalTimeout()

getWriterChunkSize

public Optional<org.apache.flink.configuration.MemorySize> getWriterChunkSize()

The chunk size to use for writes on the underlying Google WriteChannel.

isFileSinkEntropyEnabled

public Boolean isFileSinkEntropyEnabled()

Whether entropy insertion is enabled in filesink path.

toString

public String toString()

Overrides:

toString in class Object