B C D E F G I O P R S V W

B

bulkIO() - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO

BulkIO() - Constructor for class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

C

ConnectionConfiguration() - Constructor for class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

create(String[], String, String) - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

Creates a new Elasticsearch connection configuration.

create(String[], String) - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

Creates a new Elasticsearch connection configuration with no default type.

create(String[]) - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

Creates a new Elasticsearch connection configuration with no default index nor type.

create() - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

create(int, Duration) - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.RetryConfiguration

Creates RetryConfiguration for ElasticsearchIO with provided maxAttempts, maxDurations and exponential backoff based retries.

createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BoundedElasticsearchSource

D

decode(InputStream) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocumentCoder

docToBulk() - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO

DocToBulk() - Constructor for class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Document() - Constructor for class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

E

ElasticsearchIO - Class in org.apache.beam.sdk.io.elasticsearch

Transforms for reading and writing data from/to Elasticsearch.

ElasticsearchIO.BoundedElasticsearchSource - Class in org.apache.beam.sdk.io.elasticsearch

A BoundedSource reading from Elasticsearch.

ElasticsearchIO.BulkIO - Class in org.apache.beam.sdk.io.elasticsearch

A PTransform writing Bulk API entities created by ElasticsearchIO.DocToBulk to an Elasticsearch cluster.

ElasticsearchIO.ConnectionConfiguration - Class in org.apache.beam.sdk.io.elasticsearch

A POJO describing a connection configuration to Elasticsearch.

ElasticsearchIO.DocToBulk - Class in org.apache.beam.sdk.io.elasticsearch

A PTransform converting docs to their Bulk API counterparts.

ElasticsearchIO.Document - Class in org.apache.beam.sdk.io.elasticsearch

ElasticsearchIO.DocumentCoder - Class in org.apache.beam.sdk.io.elasticsearch

ElasticsearchIO.Read - Class in org.apache.beam.sdk.io.elasticsearch

A PTransform reading data from Elasticsearch.

ElasticsearchIO.RetryConfiguration - Class in org.apache.beam.sdk.io.elasticsearch

A POJO encapsulating a configuration for retry behavior when issuing requests to ES.

ElasticsearchIO.Write - Class in org.apache.beam.sdk.io.elasticsearch

A PTransform writing data to Elasticsearch.

ElasticsearchIO.Write.BooleanFieldValueExtractFn - Interface in org.apache.beam.sdk.io.elasticsearch

ElasticsearchIO.Write.FieldValueExtractFn - Interface in org.apache.beam.sdk.io.elasticsearch

encode(ElasticsearchIO.Document, OutputStream) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocumentCoder

expand(PCollection<ElasticsearchIO.Document>) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

expand(PCollection<String>) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

expand(PBegin) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

expand(PCollection<String>) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

F

FAILED_WRITES - Static variable in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

G

getAddresses() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getApiKey() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getBearerToken() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getBulkDirective() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

getBulkEndPoint() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

Generates the bulk API endpoint based on the set values.

getBulkIO() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

getConnectTimeout() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getDocToBulk() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

getEstimatedSizeBytes(PipelineOptions) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BoundedElasticsearchSource

getHasError() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

getIndex() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getInputDoc() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

getKeystorePassword() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getKeystorePath() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getOutputCoder() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BoundedElasticsearchSource

getPassword() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getResponseItemJson() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

getSocketTimeout() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getTimestamp() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

getType() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

getUsername() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

I

isTrustSelfSignedCerts() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

O

of() - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocumentCoder

org.apache.beam.sdk.io.elasticsearch - package org.apache.beam.sdk.io.elasticsearch

Transforms for reading and writing from Elasticsearch.

P

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BoundedElasticsearchSource

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

R

read() - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO

Read() - Constructor for class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

RetryConfiguration() - Constructor for class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.RetryConfiguration

S

split(long, PipelineOptions) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BoundedElasticsearchSource

SUCCESSFUL_WRITES - Static variable in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

V

validate() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BoundedElasticsearchSource

W

withAllowableResponseErrors(Set<String>) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

Provide a set of textual error types which can be contained in Bulk API response items[].error.type field.

withAllowableResponseErrors(Set<String>) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withAllowableResponseErrors(java.util.Set<java.lang.String>).

withApiKey(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If Elasticsearch authentication is enabled, provide an API key.

withAppendOnly(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide an instruction to control whether the target index should be considered append-only.

withAppendOnly(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withAppendOnly(boolean).

withBackendVersion(int) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Use to set explicitly which version of Elasticsearch the destination cluster is running.

withBackendVersion(int) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withBackendVersion(int).

withBatchSize(long) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

Provide a size for the scroll read.

withBearerToken(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If Elasticsearch authentication is enabled, provide a bearer token.

withBulkDirective(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

Sets the bulk directive representation of an input document.

withConnectionConfiguration(ElasticsearchIO.ConnectionConfiguration) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

Provide the Elasticsearch connection configuration object.

withConnectionConfiguration(ElasticsearchIO.ConnectionConfiguration) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide the Elasticsearch connection configuration object.

withConnectionConfiguration(ElasticsearchIO.ConnectionConfiguration) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

Provide the Elasticsearch connection configuration object.

withConnectionConfiguration(ElasticsearchIO.ConnectionConfiguration) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withConnectionConfiguration(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration).

withConnectTimeout(Integer) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If set, overwrites the default connect timeout (1000ms) in the RequestConfig of the Elastic RestClient.

withDocVersionFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide a function to extract the doc version from the document.

withDocVersionFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withDocVersionFn(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write.FieldValueExtractFn).

withDocVersionType(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide a function to extract the doc version from the document.

withDocVersionType(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withDocVersionType(java.lang.String).

withHasError(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

Used to set whether or not there was an error for a given document as indicated by the response from Elasticsearch.

withIdFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide a function to extract the id from the document.

withIdFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withIdFn(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write.FieldValueExtractFn).

withIgnoreVersionConflicts(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

Whether or not to suppress version conflict errors in a Bulk API response.

withIgnoreVersionConflicts(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withIgnoreVersionConflicts(boolean).

withIndexFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide a function to extract the target index from the document allowing for dynamic document routing.

withIndexFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withIndexFn(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write.FieldValueExtractFn).

withInputDoc(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

Sets the input document i.e.

withIsDeleteFn(ElasticsearchIO.Write.BooleanFieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide a function to extract the target operation either upsert or delete from the document fields allowing dynamic bulk operation decision.

withIsDeleteFn(ElasticsearchIO.Write.BooleanFieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withIsDeleteFn(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write.BooleanFieldValueExtractFn).

withKeystorePassword(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If Elasticsearch uses SSL/TLS with mutual authentication (via shield), provide the password to open the client keystore.

withKeystorePath(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If Elasticsearch uses SSL/TLS with mutual authentication (via shield), provide the keystore containing the client key.

withMaxBatchSize(long) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

Provide a maximum size in number of documents for the batch see bulk API (https://www.elastic.co/guide/en/elasticsearch/reference/2.4/docs-bulk.html).

withMaxBatchSize(long) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withMaxBatchSize(long).

withMaxBatchSizeBytes(long) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

Provide a maximum size in bytes for the batch see bulk API (https://www.elastic.co/guide/en/elasticsearch/reference/2.4/docs-bulk.html).

withMaxBatchSizeBytes(long) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withMaxBatchSizeBytes(long).

withMaxBufferingDuration(Duration) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

If using ElasticsearchIO.BulkIO.withUseStatefulBatches(boolean), this can be used to set a maximum elapsed time before buffered elements are emitted to Elasticsearch as a Bulk API request.

withMaxBufferingDuration(Duration) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withMaxBufferingDuration(org.joda.time.Duration).

withMaxParallelRequestsPerWindow(int) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

When using ElasticsearchIO.BulkIO.withUseStatefulBatches(boolean) Stateful Processing, states and therefore batches are maintained per-key-per-window.

withMaxParallelRequestsPerWindow(int) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withMaxParallelRequestsPerWindow(int).

withMetadata() - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

Include metadata in result json documents.

withPassword(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If Elasticsearch authentication is enabled, provide the password.

withQuery(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

Provide a query used while reading from Elasticsearch.

withQuery(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

Provide a ValueProvider that provides the query used while reading from Elasticsearch.

withResponseItemJson(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

Sets the element from Elasticsearch Bulk API response "items" pertaining to this WriteSummary.

withRetryConfiguration(ElasticsearchIO.RetryConfiguration) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

Provides configuration to retry a failed batch call to Elasticsearch.

withRetryConfiguration(ElasticsearchIO.RetryConfiguration) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withRetryConfiguration(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.RetryConfiguration).

withRoutingFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide a function to extract the target routing from the document allowing for dynamic document routing.

withRoutingFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withRoutingFn(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write.FieldValueExtractFn).

withScrollKeepalive(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Read

Provide a scroll keepalive.

withSocketTimeout(Integer) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If set, overwrites the default max retry timeout (30000ms) in the Elastic RestClient and the default socket timeout (30000ms) in the RequestConfig of the Elastic RestClient.

withThrowWriteErrors(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

Whether to throw runtime exceptions when write (IO) errors occur.

withThrowWriteErrors(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withThrowWriteErrors(boolean).

withTimestamp(Instant) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Document

Sets the timestamp of the element in the PCollection, to be used in order to output WriteSummary to the same window from which the inputDoc originated.

withTrustSelfSignedCerts(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If Elasticsearch uses SSL/TLS then configure whether to trust self signed certs or not.

withTypeFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide a function to extract the target type from the document allowing for dynamic document routing.

withTypeFn(ElasticsearchIO.Write.FieldValueExtractFn) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withTypeFn(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write.FieldValueExtractFn).

withUpsertScript(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Whether to use scripted updates and what script to use.

withUpsertScript(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withUpsertScript(java.lang.String).

withUsePartialUpdate(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.DocToBulk

Provide an instruction to control whether partial updates or inserts (default) are issued to Elasticsearch.

withUsePartialUpdate(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.DocToBulk.withUsePartialUpdate(boolean).

withUsername(String) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration

If Elasticsearch authentication is enabled, provide the username.

withUseStatefulBatches(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BulkIO

Whether or not to use Stateful Processing to ensure bulk requests have the desired number of entities i.e.

withUseStatefulBatches(boolean) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

Refer to ElasticsearchIO.BulkIO.withUseStatefulBatches(boolean).

write() - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO

Write() - Constructor for class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.Write

B C D E F G I O P R S V W