- GCS_HTTP_CONNECT_TIMEOUT - Static variable in class org.apache.flink.fs.gs.GSFileSystemOptions
-
Flink config option to set the http connection timeout.
- GCS_HTTP_READ_TIMEOUT - Static variable in class org.apache.flink.fs.gs.GSFileSystemOptions
-
Flink config option to set the http read timeout.
- GCS_RETRY_INIT_RPC_TIMEOUT - Static variable in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- GCS_RETRY_MAX_ATTEMPT - Static variable in class org.apache.flink.fs.gs.GSFileSystemOptions
-
Flink config option to set the http read timeout.
- GCS_RETRY_MAX_RPC_TIMEOUT - Static variable in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- GCS_RETRY_RPC_TIMEOUT_MULTIPLIER - Static variable in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- GCS_RETRY_TOTAL_TIMEOUT - Static variable in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- getBlobId() - Method in class org.apache.flink.fs.gs.storage.GSBlobIdentifier
-
Get a Google blob id for this identifier, with generation=null.
- getChecksum() - Method in interface org.apache.flink.fs.gs.storage.GSBlobStorage.BlobMetadata
-
The crc32 checksum for the blob.
- getCommitRecoverableSerializer() - Method in class org.apache.flink.fs.gs.writer.GSRecoverableWriter
-
- getenv(String) - Method in interface org.apache.flink.fs.gs.utils.ConfigUtils.ConfigContext
-
Returns a named environment variable.
- getGcsRootUrl(Configuration) - Static method in class org.apache.flink.fs.gs.utils.ConfigUtils
-
- getHadoopConfiguration(Configuration, ConfigUtils.ConfigContext) - Static method in class org.apache.flink.fs.gs.utils.ConfigUtils
-
Loads the Hadoop configuration, by loading from a Hadoop conf dir (if one exists) and then
overlaying properties derived from the Flink config.
- getHTTPConnectionTimeout() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
Timeout in millisecond to establish the connection.
- getHTTPReadTimeout() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
Timeout in millisecond to read content from connection.
- getInitialRpcTimeout() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- getMaxAttempts() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- getMaxRpcTimeout() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- getMetadata(GSBlobIdentifier) - Method in interface org.apache.flink.fs.gs.storage.GSBlobStorage
-
Gets blob metadata.
- getMetadata(GSBlobIdentifier) - Method in class org.apache.flink.fs.gs.storage.GSBlobStorageImpl
-
- getResumeRecoverableSerializer() - Method in class org.apache.flink.fs.gs.writer.GSRecoverableWriter
-
- getRpcTimeoutMultiplier() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- getScheme() - Method in class org.apache.flink.fs.gs.GSFileSystemFactory
-
- getStorageCredentials(Configuration, ConfigUtils.ConfigContext) - Static method in class org.apache.flink.fs.gs.utils.ConfigUtils
-
Creates an (optional) GoogleCredentials instance for the given Hadoop config and environment.
- getTemporaryBlobIdentifier(GSBlobIdentifier, UUID, GSFileSystemOptions) - Static method in class org.apache.flink.fs.gs.utils.BlobUtils
-
Resolves a temporary blob identifier for a provided temporary object id and the provided
options.
- getTemporaryBucketName(GSBlobIdentifier, GSFileSystemOptions) - Static method in class org.apache.flink.fs.gs.utils.BlobUtils
-
Returns the temporary bucket name.
- getTemporaryObjectName(GSBlobIdentifier, UUID) - Static method in class org.apache.flink.fs.gs.utils.BlobUtils
-
Returns a temporary object name, formed by appending the temporary object id to the temporary
object partial name, i.e. .inprogress/foo/bar/abc for the final blob with object name
"foo/bar" and temporary object id "abc".
- getTemporaryObjectNameWithEntropy(GSBlobIdentifier, UUID) - Static method in class org.apache.flink.fs.gs.utils.BlobUtils
-
Returns a temporary object name with entropy, formed by adding the temporary object id to the
temporary object partial name in both start and end of path, i.e. abc.inprogress/foo/bar/abc
for the final blob with object name "foo/bar" and temporary object id "abc".
- getTemporaryObjectPartialName(GSBlobIdentifier) - Static method in class org.apache.flink.fs.gs.utils.BlobUtils
-
Returns a temporary object partial name, i.e. .inprogress/foo/bar/ for the final blob with
object name "foo/bar".
- getTotalTimeout() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
- getWriterChunkSize() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
The chunk size to use for writes on the underlying Google WriteChannel.
- getWriterTemporaryBucketName() - Method in class org.apache.flink.fs.gs.GSFileSystemOptions
-
The temporary bucket name to use for recoverable writes, if different from the final bucket
name.
- GSBlobIdentifier - Class in org.apache.flink.fs.gs.storage
-
An abstraction for the Google BlobId type.
- GSBlobIdentifier(String, String) - Constructor for class org.apache.flink.fs.gs.storage.GSBlobIdentifier
-
Construct an abstract blob identifier.
- GSBlobStorage - Interface in org.apache.flink.fs.gs.storage
-
Abstract blob storage, used to simplify interface to Google storage and make it mockable.
- GSBlobStorage.BlobMetadata - Interface in org.apache.flink.fs.gs.storage
-
Abstract blob metadata.
- GSBlobStorage.WriteChannel - Interface in org.apache.flink.fs.gs.storage
-
Abstract blob write channel.
- GSBlobStorageImpl - Class in org.apache.flink.fs.gs.storage
-
BlobStorage implementation for Google storage.
- GSBlobStorageImpl(Storage) - Constructor for class org.apache.flink.fs.gs.storage.GSBlobStorageImpl
-
Constructs a GSBlobStorage instance.
- GSFileSystemFactory - Class in org.apache.flink.fs.gs
-
Implementation of the Flink FileSystemFactory interface for
Google Storage.
- GSFileSystemFactory() - Constructor for class org.apache.flink.fs.gs.GSFileSystemFactory
-
Constructs the Google Storage file system factory.
- GSFileSystemOptions - Class in org.apache.flink.fs.gs
-
The GS file system options.
- GSFileSystemOptions(Configuration) - Constructor for class org.apache.flink.fs.gs.GSFileSystemOptions
-
Constructs an options instance.
- GSRecoverableWriter - Class in org.apache.flink.fs.gs.writer
-
The recoverable writer implementation for Google storage.
- GSRecoverableWriter(GSBlobStorage, GSFileSystemOptions) - Constructor for class org.apache.flink.fs.gs.writer.GSRecoverableWriter
-
Construct a GS recoverable writer.