public class NonRollingBucketer extends Object implements Bucketer
Bucketer that does not perform any
rolling of files. All files are written to the base path.| Constructor and Description |
|---|
NonRollingBucketer() |
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.fs.Path |
getNextBucketPath(org.apache.hadoop.fs.Path basePath)
Returns the
Path of a new bucket file. |
boolean |
shouldStartNewBucket(org.apache.hadoop.fs.Path basePath,
org.apache.hadoop.fs.Path currentBucketPath)
Returns
true when a new bucket should be started. |
String |
toString() |
public boolean shouldStartNewBucket(org.apache.hadoop.fs.Path basePath,
org.apache.hadoop.fs.Path currentBucketPath)
Bucketertrue when a new bucket should be started.shouldStartNewBucket in interface BucketercurrentBucketPath - The bucket Path that is currently being used.public org.apache.hadoop.fs.Path getNextBucketPath(org.apache.hadoop.fs.Path basePath)
BucketerPath of a new bucket file.getNextBucketPath in interface BucketerbasePath - The base path containing all the buckets.Path of the new bucket. This should include the basePath
and also the subtaskIndex tp avoid clashes with parallel sinks.Copyright © 2014–2016 The Apache Software Foundation. All rights reserved.