org.apache.beam.sdk.io.hdfs

Interface HadoopFileSystemOptions

All Superinterfaces:

org.apache.beam.sdk.transforms.display.HasDisplayData, org.apache.beam.sdk.options.PipelineOptions

@Experimental(value=FILESYSTEM)
public interface HadoopFileSystemOptions
extends org.apache.beam.sdk.options.PipelineOptions

PipelineOptions which encapsulate Hadoop Configuration for the HadoopFileSystem.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	HadoopFileSystemOptions.ConfigurationLocator A DefaultValueFactory which locates a Hadoop Configuration.

Nested classes/interfaces inherited from interface org.apache.beam.sdk.options.PipelineOptions

org.apache.beam.sdk.options.PipelineOptions.AtomicLongFactory, org.apache.beam.sdk.options.PipelineOptions.CheckEnabled, org.apache.beam.sdk.options.PipelineOptions.DirectRunner, org.apache.beam.sdk.options.PipelineOptions.JobNameFactory, org.apache.beam.sdk.options.PipelineOptions.UserAgentFactory

Method Summary

Modifier and Type	Method and Description
java.util.List<org.apache.hadoop.conf.Configuration>	getHdfsConfiguration()
void	setHdfsConfiguration(java.util.List<org.apache.hadoop.conf.Configuration> value)

Methods inherited from interface org.apache.beam.sdk.options.PipelineOptions

as, getJobName, getOptionsId, getRunner, getStableUniqueNames, getTempLocation, getUserAgent, outputRuntimeOptions, setJobName, setOptionsId, setRunner, setStableUniqueNames, setTempLocation, setUserAgent

Methods inherited from interface org.apache.beam.sdk.transforms.display.HasDisplayData

populateDisplayData

Method Detail

getHdfsConfiguration

@Default.InstanceFactory(value=HadoopFileSystemOptions.ConfigurationLocator.class)
java.util.List<org.apache.hadoop.conf.Configuration> getHdfsConfiguration()

setHdfsConfiguration

void setHdfsConfiguration(java.util.List<org.apache.hadoop.conf.Configuration> value)