| Package | Description |
|---|---|
| org.apache.flink.api.common.io | |
| org.apache.flink.core.fs | |
| org.apache.flink.core.io |
| Modifier and Type | Interface and Description |
|---|---|
interface |
CheckpointableInputFormat<S extends InputSplit,T extends Serializable>
An interface that describes
InputFormats that allow checkpointing/restoring their state. |
interface |
InputFormat<OT,T extends InputSplit>
The base interface for data sources that produces records.
|
class |
ReplicatingInputFormat<OT,S extends InputSplit>
A ReplicatingInputFormat replicates any
InputFormat to all parallel instances of a DataSource,
i.e., the full input of the replicated InputFormat is completely processed by each parallel instance of the DataSource. |
class |
RichInputFormat<OT,T extends InputSplit>
An abstract stub implementation for Rich input formats.
|
| Modifier and Type | Method and Description |
|---|---|
T[] |
InputFormat.createInputSplits(int minNumSplits)
Creates the different splits of the input that can be processed in parallel.
|
S[] |
ReplicatingInputFormat.createInputSplits(int minNumSplits) |
InputSplit |
ReplicatingInputSplitAssigner.getNextInputSplit(String host,
int taskId) |
InputSplit |
DefaultInputSplitAssigner.getNextInputSplit(String host,
int taskId) |
| Modifier and Type | Method and Description |
|---|---|
InputSplitAssigner |
ReplicatingInputFormat.getInputSplitAssigner(S[] inputSplits) |
InputSplitAssigner |
InputFormat.getInputSplitAssigner(T[] inputSplits)
Gets the type of the input splits that are processed by this input format.
|
| Constructor and Description |
|---|
DefaultInputSplitAssigner(InputSplit[] splits) |
ReplicatingInputSplitAssigner(InputSplit[] splits) |
| Constructor and Description |
|---|
DefaultInputSplitAssigner(Collection<? extends InputSplit> splits) |
ReplicatingInputSplitAssigner(Collection<InputSplit> splits) |
| Modifier and Type | Class and Description |
|---|---|
class |
FileInputSplit
A file input split provides information on a particular part of a file, possibly
hosted on a distributed file system and replicated among several hosts.
|
| Modifier and Type | Interface and Description |
|---|---|
interface |
InputSplitSource<T extends InputSplit>
InputSplitSources create
InputSplits that define portions of data to be produced
by InputFormats. |
| Modifier and Type | Class and Description |
|---|---|
class |
GenericInputSplit
A generic input split that has only a partition number.
|
class |
LocatableInputSplit
A locatable input split is an input split referring to input data which is located on one or more hosts.
|
| Modifier and Type | Method and Description |
|---|---|
T[] |
InputSplitSource.createInputSplits(int minNumSplits)
Computes the input splits.
|
InputSplit |
InputSplitAssigner.getNextInputSplit(String host,
int taskId)
Returns the next input split that shall be consumed.
|
| Modifier and Type | Method and Description |
|---|---|
InputSplitAssigner |
InputSplitSource.getInputSplitAssigner(T[] inputSplits)
Returns the assigner for the input splits.
|
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.