org.apache.beam.sdk.extensions.sorter

Class BufferedExternalSorter

java.lang.Object

org.apache.beam.sdk.extensions.sorter.BufferedExternalSorter

public class BufferedExternalSorter
extends Object

Sorter that will use in memory sorting until the values can't fit into memory and will then fall back to external sorting.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BufferedExternalSorter.Options Contains configuration for the sorter.

Method Summary

Modifier and Type	Method and Description
void	add(KV<byte[],byte[]> record) Adds a given record to the sorter.
static BufferedExternalSorter	create(BufferedExternalSorter.Options options)
Iterable<KV<byte[],byte[]>>	sort() Sorts the added elements and returns an Iterable over the sorted elements.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

create

public static BufferedExternalSorter create(BufferedExternalSorter.Options options)

add

public void add(KV<byte[],byte[]> record)
         throws IOException

Adds a given record to the sorter.

Records can only be added before calling sort().

Throws:

IOException

sort

public Iterable<KV<byte[],byte[]>> sort()
                                 throws IOException

Sorts the added elements and returns an Iterable over the sorted elements.

Can be called at most once.

Throws:

IOException