C E F G O P R V W
All Classes All Packages

C

ContextualTextIO - Class in org.apache.beam.sdk.io.contextualtextio

PTransforms that read text files and collect contextual information of the elements in the input.

ContextualTextIO.Read - Class in org.apache.beam.sdk.io.contextualtextio

Implementation of ContextualTextIO.read().

ContextualTextIO.ReadFiles - Class in org.apache.beam.sdk.io.contextualtextio

Implementation of ContextualTextIO.readFiles().

E

expand(PBegin) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

expand(PCollection<FileIO.ReadableFile>) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.ReadFiles

F

from(String) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

Reads text from the file(s) with the given filename or filename pattern.

from(ValueProvider<String>) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

Same as from(filepattern), but accepting a ValueProvider.

G

getSchema() - Static method in class org.apache.beam.sdk.io.contextualtextio.RecordWithMetadata

getSource() - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

O

org.apache.beam.sdk.io.contextualtextio - package org.apache.beam.sdk.io.contextualtextio

Transforms for reading from Files with contextual Information.

P

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

populateDisplayData(DisplayData.Builder) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.ReadFiles

R

RANGE_OFFSET - Static variable in class org.apache.beam.sdk.io.contextualtextio.RecordWithMetadata

read() - Static method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO

A PTransform that reads from one or more text files and returns a bounded PCollection containing one element for each line in the input files.

Read() - Constructor for class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

readFiles() - Static method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO

Like ContextualTextIO.read(), but reads each file in a PCollection of FileIO.ReadableFile, returned by FileIO.readMatches().

ReadFiles() - Constructor for class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.ReadFiles

RECORD_NUM - Static variable in class org.apache.beam.sdk.io.contextualtextio.RecordWithMetadata

RECORD_NUM_IN_OFFSET - Static variable in class org.apache.beam.sdk.io.contextualtextio.RecordWithMetadata

RECORD_OFFSET - Static variable in class org.apache.beam.sdk.io.contextualtextio.RecordWithMetadata

RecordWithMetadata - Class in org.apache.beam.sdk.io.contextualtextio

Helper Class based on Row, it provides Metadata associated with each Record when reading from file(s) using ContextualTextIO.

RecordWithMetadata() - Constructor for class org.apache.beam.sdk.io.contextualtextio.RecordWithMetadata

RESOURCE_ID - Static variable in class org.apache.beam.sdk.io.contextualtextio.RecordWithMetadata

V

VALUE - Static variable in class org.apache.beam.sdk.io.contextualtextio.RecordWithMetadata

W

withCompression(Compression) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

Reads from input sources using the specified compression type.

withDelimiter(byte[]) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

Set the custom delimiter to be used in place of the default ones ('\r', '\n' or '\r\n').

withDelimiter(byte[]) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.ReadFiles

Like ContextualTextIO.Read.withDelimiter(byte[]).

withEmptyMatchTreatment(EmptyMatchTreatment) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

See FileIO.MatchConfiguration.withEmptyMatchTreatment(org.apache.beam.sdk.io.fs.EmptyMatchTreatment).

withHasMultilineCSVRecords(Boolean) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

When reading RFC4180 CSV files that have values that span multiple lines, set this to true.

withHintMatchesManyFiles() - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

Hints that the filepattern specified in ContextualTextIO.Read.from(String) matches a very large number of files.

withMatchConfiguration(FileIO.MatchConfiguration) - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

Sets the FileIO.MatchConfiguration.

withRecordNumMetadata() - Method in class org.apache.beam.sdk.io.contextualtextio.ContextualTextIO.Read

Allows the user to opt into getting recordNums associated with each record.

C E F G O P R V W
All Classes All Packages