| Constructor and Description |
|---|
DistributedCache(Map<String,Future<Path>> cacheCopyTasks) |
| Constructor and Description |
|---|
AbstractRuntimeUDFContext(TaskInfo taskInfo,
ClassLoader userCodeClassLoader,
ExecutionConfig executionConfig,
Map<String,Accumulator<?,?>> accumulators,
Map<String,Future<Path>> cpTasks,
org.apache.flink.metrics.MetricGroup metrics) |
RuntimeUDFContext(TaskInfo taskInfo,
ClassLoader userCodeClassLoader,
ExecutionConfig executionConfig,
Map<String,Future<Path>> cpTasks,
Map<String,Accumulator<?,?>> accumulators,
org.apache.flink.metrics.MetricGroup metrics) |
| Modifier and Type | Field and Description |
|---|---|
protected Path |
FileInputFormat.filePath
Deprecated.
Please override
FileInputFormat.supportsMultiPaths() and
use FileInputFormat.getFilePaths() and FileInputFormat.setFilePaths(Path...). |
protected Path |
FileOutputFormat.outputFilePath
The path of the file to be written.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
FileInputFormat.getFilePath()
Deprecated.
Please use getFilePaths() instead.
|
Path[] |
FileInputFormat.getFilePaths()
Returns the paths of all files to be read by the FileInputFormat.
|
Path |
FileOutputFormat.getOutputFilePath() |
| Modifier and Type | Method and Description |
|---|---|
boolean |
GlobFilePathFilter.filterPath(Path filePath) |
abstract boolean |
FilePathFilter.filterPath(Path filePath)
Returns
true if the filePath given is to be
ignored when processing a directory, e.g. |
boolean |
FilePathFilter.DefaultFilter.filterPath(Path filePath) |
protected FileInputFormat.FileBaseStatistics |
FileInputFormat.getFileStats(FileInputFormat.FileBaseStatistics cachedStats,
Path[] filePaths,
ArrayList<FileStatus> files) |
protected FileInputFormat.FileBaseStatistics |
FileInputFormat.getFileStats(FileInputFormat.FileBaseStatistics cachedStats,
Path filePath,
FileSystem fs,
ArrayList<FileStatus> files) |
void |
FileInputFormat.setFilePath(Path filePath)
Sets a single path of a file to be read.
|
void |
FileInputFormat.setFilePaths(Path... filePaths)
Sets multiple paths of files to be read.
|
void |
FileOutputFormat.setOutputFilePath(Path path) |
| Constructor and Description |
|---|
DelimitedInputFormat(Path filePath,
Configuration configuration) |
FileInputFormat(Path filePath) |
FileOutputFormat(Path outputPath) |
GenericCsvInputFormat(Path filePath) |
| Modifier and Type | Method and Description |
|---|---|
static Path |
Path.fromLocalFile(File file)
Creates a path for the given local file.
|
Path |
LimitedConnectionsFileSystem.getHomeDirectory() |
Path |
SafetyNetWrapperFileSystem.getHomeDirectory() |
abstract Path |
FileSystem.getHomeDirectory()
Returns the path of the user's home directory in this file system.
|
Path |
Path.getParent()
Returns the parent of a path, i.e., everything that precedes the last separator
or
null if at root. |
Path |
FileInputSplit.getPath()
Returns the path of the file containing this split's data.
|
Path |
FileStatus.getPath()
Returns the corresponding Path to the FileStatus.
|
Path |
LimitedConnectionsFileSystem.getWorkingDirectory() |
Path |
SafetyNetWrapperFileSystem.getWorkingDirectory() |
abstract Path |
FileSystem.getWorkingDirectory()
Returns the path of the file system's current working directory.
|
Path |
Path.makeQualified(FileSystem fs)
Returns a qualified path object.
|
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path.
|
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite)
Deprecated.
Use
FileSystem.create(Path, WriteMode) instead. |
FSDataOutputStream |
LimitedConnectionsFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Deprecated.
|
FSDataOutputStream |
SafetyNetWrapperFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize) |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Deprecated.
Deprecated because not well supported across types of file systems.
Control the behavior of specific file systems via configurations instead.
|
FSDataOutputStream |
LimitedConnectionsFileSystem.create(Path f,
FileSystem.WriteMode overwriteMode) |
FSDataOutputStream |
SafetyNetWrapperFileSystem.create(Path f,
FileSystem.WriteMode overwrite) |
abstract FSDataOutputStream |
FileSystem.create(Path f,
FileSystem.WriteMode overwriteMode)
Opens an FSDataOutputStream to a new file at the given path.
|
boolean |
LimitedConnectionsFileSystem.delete(Path f,
boolean recursive) |
boolean |
SafetyNetWrapperFileSystem.delete(Path f,
boolean recursive) |
abstract boolean |
FileSystem.delete(Path f,
boolean recursive)
Delete a file.
|
boolean |
LimitedConnectionsFileSystem.exists(Path f) |
boolean |
SafetyNetWrapperFileSystem.exists(Path f) |
boolean |
FileSystem.exists(Path f)
Check if exists.
|
FileStatus |
LimitedConnectionsFileSystem.getFileStatus(Path f) |
FileStatus |
SafetyNetWrapperFileSystem.getFileStatus(Path f) |
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path.
|
boolean |
SafetyNetWrapperFileSystem.initOutPathDistFS(Path outPath,
FileSystem.WriteMode writeMode,
boolean createDirectory) |
boolean |
FileSystem.initOutPathDistFS(Path outPath,
FileSystem.WriteMode writeMode,
boolean createDirectory)
Initializes output directories on distributed file systems according to the given write mode.
|
boolean |
SafetyNetWrapperFileSystem.initOutPathLocalFS(Path outPath,
FileSystem.WriteMode writeMode,
boolean createDirectory) |
boolean |
FileSystem.initOutPathLocalFS(Path outPath,
FileSystem.WriteMode writeMode,
boolean createDirectory)
Initializes output directories on local file systems according to the given write mode.
|
FileStatus[] |
LimitedConnectionsFileSystem.listStatus(Path f) |
FileStatus[] |
SafetyNetWrapperFileSystem.listStatus(Path f) |
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
boolean |
LimitedConnectionsFileSystem.mkdirs(Path f) |
boolean |
SafetyNetWrapperFileSystem.mkdirs(Path f) |
abstract boolean |
FileSystem.mkdirs(Path f)
Make the given file and all non-existent parents into directories.
|
FSDataInputStream |
LimitedConnectionsFileSystem.open(Path f) |
FSDataInputStream |
SafetyNetWrapperFileSystem.open(Path f) |
abstract FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path.
|
RecoverableFsDataOutputStream |
RecoverableWriter.open(Path path)
Opens a new recoverable stream to write to the given path.
|
FSDataInputStream |
LimitedConnectionsFileSystem.open(Path f,
int bufferSize) |
FSDataInputStream |
SafetyNetWrapperFileSystem.open(Path f,
int bufferSize) |
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
boolean |
LimitedConnectionsFileSystem.rename(Path src,
Path dst) |
boolean |
SafetyNetWrapperFileSystem.rename(Path src,
Path dst) |
abstract boolean |
FileSystem.rename(Path src,
Path dst)
Renames the file/directory src to dst.
|
| Constructor and Description |
|---|
FileInputSplit(int num,
Path file,
long start,
long length,
String[] hosts)
Constructs a split with host information.
|
Path(Path parent,
Path child)
Resolve a child path against a parent path.
|
Path(Path parent,
String child)
Resolve a child path against a parent path.
|
Path(String parent,
Path child)
Resolve a child path against a parent path.
|
| Modifier and Type | Method and Description |
|---|---|
Path |
LocalFileSystem.getHomeDirectory() |
Path |
LocalFileStatus.getPath() |
Path |
LocalFileSystem.getWorkingDirectory() |
| Modifier and Type | Method and Description |
|---|---|
FSDataOutputStream |
LocalFileSystem.create(Path filePath,
FileSystem.WriteMode overwrite) |
boolean |
LocalFileSystem.delete(Path f,
boolean recursive) |
boolean |
LocalFileSystem.exists(Path f) |
FileStatus |
LocalFileSystem.getFileStatus(Path f) |
FileStatus[] |
LocalFileSystem.listStatus(Path f) |
boolean |
LocalFileSystem.mkdirs(Path f)
Recursively creates the directory specified by the provided path.
|
RecoverableFsDataOutputStream |
LocalRecoverableWriter.open(Path filePath) |
FSDataInputStream |
LocalFileSystem.open(Path f) |
FSDataInputStream |
LocalFileSystem.open(Path f,
int bufferSize) |
File |
LocalFileSystem.pathToFile(Path path)
Converts the given Path to a File for this file system.
|
boolean |
LocalFileSystem.rename(Path src,
Path dst) |
| Modifier and Type | Method and Description |
|---|---|
static Path |
FileUtils.compressDirectory(Path directory,
Path target) |
static Path |
FileUtils.expandDirectory(Path file,
Path targetDirectory) |
| Modifier and Type | Method and Description |
|---|---|
static Path |
FileUtils.compressDirectory(Path directory,
Path target) |
static void |
FileUtils.copy(Path sourcePath,
Path targetPath,
boolean executable)
Copies all files from source to target and sets executable flag.
|
static boolean |
FileUtils.deletePathIfEmpty(FileSystem fileSystem,
Path path)
Deletes the path if it is empty.
|
static Path |
FileUtils.expandDirectory(Path file,
Path targetDirectory) |
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.