org.apache.flink.runtime.fs.hdfs

类 HadoopFileSystem

java.lang.Object

org.apache.flink.core.fs.FileSystem

org.apache.flink.runtime.fs.hdfs.HadoopFileSystem

public class HadoopFileSystem
extends org.apache.flink.core.fs.FileSystem

A FileSystem that wraps an Hadoop File System.

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.core.fs.FileSystem

org.apache.flink.core.fs.FileSystem.WriteMode

构造器概要

构造器

构造器和说明
HadoopFileSystem(org.apache.hadoop.fs.FileSystem hadoopFileSystem) Wraps the given Hadoop File System object as a Flink File System object.

方法概要

限定符和类型	方法和说明
HadoopDataOutputStream	create(org.apache.flink.core.fs.Path f, boolean overwrite, int bufferSize, short replication, long blockSize)
HadoopDataOutputStream	create(org.apache.flink.core.fs.Path f, org.apache.flink.core.fs.FileSystem.WriteMode overwrite)
org.apache.flink.core.fs.RecoverableWriter	createRecoverableWriter()
boolean	delete(org.apache.flink.core.fs.Path f, boolean recursive)
boolean	exists(org.apache.flink.core.fs.Path f)
long	getDefaultBlockSize()
org.apache.flink.core.fs.BlockLocation[]	getFileBlockLocations(org.apache.flink.core.fs.FileStatus file, long start, long len)
org.apache.flink.core.fs.FileStatus	getFileStatus(org.apache.flink.core.fs.Path f)
org.apache.hadoop.fs.FileSystem	getHadoopFileSystem() Gets the underlying Hadoop FileSystem.
org.apache.flink.core.fs.Path	getHomeDirectory()
org.apache.flink.core.fs.FileSystemKind	getKind()
URI	getUri()
org.apache.flink.core.fs.Path	getWorkingDirectory()
boolean	isDistributedFS()
org.apache.flink.core.fs.FileStatus[]	listStatus(org.apache.flink.core.fs.Path f)
boolean	mkdirs(org.apache.flink.core.fs.Path f)
HadoopDataInputStream	open(org.apache.flink.core.fs.Path f)
HadoopDataInputStream	open(org.apache.flink.core.fs.Path f, int bufferSize)
boolean	rename(org.apache.flink.core.fs.Path src, org.apache.flink.core.fs.Path dst)
static org.apache.hadoop.fs.Path	toHadoopPath(org.apache.flink.core.fs.Path path)

从类继承的方法 org.apache.flink.core.fs.FileSystem

create, get, getDefaultFsUri, getLocalFileSystem, getUnguardedFileSystem, initialize, initialize, initOutPathDistFS, initOutPathLocalFS

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HadoopFileSystem

public HadoopFileSystem(org.apache.hadoop.fs.FileSystem hadoopFileSystem)

Wraps the given Hadoop File System object as a Flink File System object. The given Hadoop file system object is expected to be initialized already.

参数:

hadoopFileSystem - The Hadoop FileSystem that will be used under the hood.

方法详细资料

getHadoopFileSystem

public org.apache.hadoop.fs.FileSystem getHadoopFileSystem()

Gets the underlying Hadoop FileSystem.

返回:

The underlying Hadoop FileSystem.

getWorkingDirectory

public org.apache.flink.core.fs.Path getWorkingDirectory()

指定者:

getWorkingDirectory 在类中 org.apache.flink.core.fs.FileSystem

getHomeDirectory

public org.apache.flink.core.fs.Path getHomeDirectory()

指定者:

getHomeDirectory 在类中 org.apache.flink.core.fs.FileSystem

getUri

public URI getUri()

指定者:

getUri 在类中 org.apache.flink.core.fs.FileSystem

getFileStatus

public org.apache.flink.core.fs.FileStatus getFileStatus(org.apache.flink.core.fs.Path f)
                                                  throws IOException

指定者:

getFileStatus 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

getFileBlockLocations

public org.apache.flink.core.fs.BlockLocation[] getFileBlockLocations(org.apache.flink.core.fs.FileStatus file,
                                                                      long start,
                                                                      long len)
                                                               throws IOException

指定者:

getFileBlockLocations 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

open

public HadoopDataInputStream open(org.apache.flink.core.fs.Path f,
                                  int bufferSize)
                           throws IOException

指定者:

open 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

open

public HadoopDataInputStream open(org.apache.flink.core.fs.Path f)
                           throws IOException

指定者:

open 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

create

public HadoopDataOutputStream create(org.apache.flink.core.fs.Path f,
                                     boolean overwrite,
                                     int bufferSize,
                                     short replication,
                                     long blockSize)
                              throws IOException

覆盖:

create 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

create

public HadoopDataOutputStream create(org.apache.flink.core.fs.Path f,
                                     org.apache.flink.core.fs.FileSystem.WriteMode overwrite)
                              throws IOException

指定者:

create 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

delete

public boolean delete(org.apache.flink.core.fs.Path f,
                      boolean recursive)
               throws IOException

指定者:

delete 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

exists

public boolean exists(org.apache.flink.core.fs.Path f)
               throws IOException

覆盖:

exists 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

listStatus

public org.apache.flink.core.fs.FileStatus[] listStatus(org.apache.flink.core.fs.Path f)
                                                 throws IOException

指定者:

listStatus 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

mkdirs

public boolean mkdirs(org.apache.flink.core.fs.Path f)
               throws IOException

指定者:

mkdirs 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

rename

public boolean rename(org.apache.flink.core.fs.Path src,
                      org.apache.flink.core.fs.Path dst)
               throws IOException

指定者:

rename 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

getDefaultBlockSize

public long getDefaultBlockSize()

覆盖:

getDefaultBlockSize 在类中 org.apache.flink.core.fs.FileSystem

isDistributedFS

public boolean isDistributedFS()

指定者:

isDistributedFS 在类中 org.apache.flink.core.fs.FileSystem

getKind

public org.apache.flink.core.fs.FileSystemKind getKind()

指定者:

getKind 在类中 org.apache.flink.core.fs.FileSystem

createRecoverableWriter

public org.apache.flink.core.fs.RecoverableWriter createRecoverableWriter()
                                                                   throws IOException

覆盖:

createRecoverableWriter 在类中 org.apache.flink.core.fs.FileSystem

抛出:

IOException

toHadoopPath

public static org.apache.hadoop.fs.Path toHadoopPath(org.apache.flink.core.fs.Path path)