| Constructor and Description |
|---|
DistributedCache(Map<String,Future<Path>> cacheCopyTasks) |
| Constructor and Description |
|---|
AbstractRuntimeUDFContext(TaskInfo taskInfo,
ClassLoader userCodeClassLoader,
ExecutionConfig executionConfig,
Map<String,Accumulator<?,?>> accumulators,
Map<String,Future<Path>> cpTasks,
MetricGroup metrics) |
RuntimeUDFContext(TaskInfo taskInfo,
ClassLoader userCodeClassLoader,
ExecutionConfig executionConfig,
Map<String,Future<Path>> cpTasks,
Map<String,Accumulator<?,?>> accumulators,
MetricGroup metrics) |
| Modifier and Type | Field and Description |
|---|---|
protected Path |
FileInputFormat.filePath
The path to the file that contains the input.
|
protected Path |
FileOutputFormat.outputFilePath
The path of the file to be written.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
FileInputFormat.getFilePath() |
Path |
FileOutputFormat.getOutputFilePath() |
| Modifier and Type | Method and Description |
|---|---|
boolean |
GlobFilePathFilter.filterPath(Path filePath) |
abstract boolean |
FilePathFilter.filterPath(Path filePath)
Returns
true if the filePath given is to be
ignored when processing a directory, e.g. |
boolean |
FilePathFilter.DefaultFilter.filterPath(Path filePath) |
protected FileInputFormat.FileBaseStatistics |
FileInputFormat.getFileStats(FileInputFormat.FileBaseStatistics cachedStats,
Path filePath,
FileSystem fs,
ArrayList<FileStatus> files) |
void |
FileInputFormat.setFilePath(Path filePath) |
void |
FileOutputFormat.setOutputFilePath(Path path) |
| Constructor and Description |
|---|
DelimitedInputFormat(Path filePath,
Configuration configuration) |
FileInputFormat(Path filePath) |
FileOutputFormat(Path outputPath) |
GenericCsvInputFormat(Path filePath) |
| Modifier and Type | Method and Description |
|---|---|
abstract Path |
FileSystem.getHomeDirectory()
Returns the path of the user's home directory in this file system.
|
Path |
SafetyNetWrapperFileSystem.getHomeDirectory() |
Path |
Path.getParent()
Returns the parent of a path, i.e., everything that precedes the last separator
or
null if at root. |
Path |
FileStatus.getPath()
Returns the corresponding Path to the FileStatus.
|
Path |
FileInputSplit.getPath()
Returns the path of the file containing this split's data.
|
abstract Path |
FileSystem.getWorkingDirectory()
Returns the path of the file system's current working directory.
|
Path |
SafetyNetWrapperFileSystem.getWorkingDirectory() |
Path |
Path.makeQualified(FileSystem fs)
Returns a qualified path object.
|
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path.
|
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite)
Deprecated.
Use
FileSystem.create(Path, WriteMode) instead. |
abstract FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Deprecated.
Deprecated because not well supported across types of file systems.
Control the behavior of specific file systems via configurations instead.
|
FSDataOutputStream |
SafetyNetWrapperFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize) |
abstract FSDataOutputStream |
FileSystem.create(Path f,
FileSystem.WriteMode overwriteMode)
Opens an FSDataOutputStream to a new file at the given path.
|
FSDataOutputStream |
SafetyNetWrapperFileSystem.create(Path f,
FileSystem.WriteMode overwrite) |
abstract boolean |
FileSystem.delete(Path f,
boolean recursive)
Delete a file.
|
boolean |
SafetyNetWrapperFileSystem.delete(Path f,
boolean recursive) |
boolean |
FileSystem.exists(Path f)
Check if exists.
|
boolean |
SafetyNetWrapperFileSystem.exists(Path f) |
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus |
SafetyNetWrapperFileSystem.getFileStatus(Path f) |
boolean |
FileSystem.initOutPathDistFS(Path outPath,
FileSystem.WriteMode writeMode,
boolean createDirectory)
Initializes output directories on distributed file systems according to the given write mode.
|
boolean |
SafetyNetWrapperFileSystem.initOutPathDistFS(Path outPath,
FileSystem.WriteMode writeMode,
boolean createDirectory) |
boolean |
FileSystem.initOutPathLocalFS(Path outPath,
FileSystem.WriteMode writeMode,
boolean createDirectory)
Initializes output directories on local file systems according to the given write mode.
|
boolean |
SafetyNetWrapperFileSystem.initOutPathLocalFS(Path outPath,
FileSystem.WriteMode writeMode,
boolean createDirectory) |
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
SafetyNetWrapperFileSystem.listStatus(Path f) |
abstract boolean |
FileSystem.mkdirs(Path f)
Make the given file and all non-existent parents into directories.
|
boolean |
SafetyNetWrapperFileSystem.mkdirs(Path f) |
abstract FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
SafetyNetWrapperFileSystem.open(Path f) |
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
SafetyNetWrapperFileSystem.open(Path f,
int bufferSize) |
abstract boolean |
FileSystem.rename(Path src,
Path dst)
Renames the file/directory src to dst.
|
boolean |
SafetyNetWrapperFileSystem.rename(Path src,
Path dst) |
| Constructor and Description |
|---|
FileInputSplit(int num,
Path file,
long start,
long length,
String[] hosts)
Constructs a split with host information.
|
Path(Path parent,
Path child)
Resolve a child path against a parent path.
|
Path(Path parent,
String child)
Resolve a child path against a parent path.
|
Path(String parent,
Path child)
Resolve a child path against a parent path.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
LocalFileSystem.getHomeDirectory() |
Path |
LocalFileStatus.getPath() |
Path |
LocalFileSystem.getWorkingDirectory() |
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
LocalFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize) |
FSDataOutputStream |
LocalFileSystem.create(Path filePath,
FileSystem.WriteMode overwrite) |
boolean |
LocalFileSystem.delete(Path f,
boolean recursive) |
FileStatus |
LocalFileSystem.getFileStatus(Path f) |
FileStatus[] |
LocalFileSystem.listStatus(Path f) |
boolean |
LocalFileSystem.mkdirs(Path f)
Recursively creates the directory specified by the provided path.
|
FSDataInputStream |
LocalFileSystem.open(Path f) |
FSDataInputStream |
LocalFileSystem.open(Path f,
int bufferSize) |
boolean |
LocalFileSystem.rename(Path src,
Path dst) |
| Modifier and Type | Method and Description |
|---|---|
static boolean |
FileUtils.deletePathIfEmpty(FileSystem fileSystem,
Path path)
Deletes the path if it is empty.
|
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.