org.apache.fluo.mapreduce

Class FluoKeyValueGenerator

java.lang.Object

org.apache.fluo.mapreduce.FluoKeyValueGenerator

public class FluoKeyValueGenerator
extends Object

This class allows generating Accumulo key values that are in the Fluo data format. This class is intended to be used with AccumuloFileOutputFormat inorder to seed an initialized Fluo table on which no transactions have executed.

This class generates multiple Accumulo key values for a single Fluo row and column. The key values generated are guaranteed to be in sorted order.

This class is designed to be reused inorder to avoid object creation in a map reduce job.

 
   // this could be shared between calls to map or reduce, to avoid creating for each call.
   FluoKeyValueGenerator fkvg = new FluoKeyValueGenerator();
   // could also reuse column objects.
   Column column = new Column("fam1", "fam2");
 
   fkvg.setRow("row1").setColumn(column).setValue("val2");
 
   for (FluoKeyValue fluoKeyValue : fkvg.getKeyValues())
     writeToAccumuloFile(fluoKeyValue);
 
   fkvg.setRow("row2").setColumn(column).setValue("val3");
 
   // Each call to getKeyValues() returns the same objects populated with different data when
   // possible. So subsequent calls to getKeyValues() will create less objects. Of course this
   // invalidates what was returned by previous calls to getKeyValues().
   for (FluoKeyValue fluoKeyValue : fkvg.getKeyValues())
     writeToAccumuloFile(fluoKeyValue);
 
 

Constructor Summary

Constructors

Constructor and Description
FluoKeyValueGenerator()

Method Summary

Modifier and Type	Method and Description
FluoKeyValue[]	getKeyValues() Translates the Fluo row, column, and value set into the persistent format that is stored in Accumulo.
FluoKeyValueGenerator	set(RowColumnValue rcv) Set the row, column, and value
FluoKeyValueGenerator	setColumn(Column col)
FluoKeyValueGenerator	setRow(byte[] row)
FluoKeyValueGenerator	setRow(Bytes row)
FluoKeyValueGenerator	setRow(String row) This method will use UTF-8 to encode the string as bytes.
FluoKeyValueGenerator	setRow(org.apache.hadoop.io.Text row)
FluoKeyValueGenerator	setValue(byte[] val)
FluoKeyValueGenerator	setValue(Bytes val)
FluoKeyValueGenerator	setValue(String val) This method will use UTF-8 to encode the string as bytes.
FluoKeyValueGenerator	setValue(org.apache.hadoop.io.Text val)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FluoKeyValueGenerator

public FluoKeyValueGenerator()

Method Detail

setRow

public FluoKeyValueGenerator setRow(byte[] row)

Returns:

this

setRow

public FluoKeyValueGenerator setRow(org.apache.hadoop.io.Text row)

Returns:

this

setRow

public FluoKeyValueGenerator setRow(Bytes row)

Returns:

this

setRow

public FluoKeyValueGenerator setRow(String row)

This method will use UTF-8 to encode the string as bytes.

Returns:

this

setColumn

public FluoKeyValueGenerator setColumn(Column col)

Returns:

this

setValue

public FluoKeyValueGenerator setValue(byte[] val)

Returns:

this

setValue

public FluoKeyValueGenerator setValue(org.apache.hadoop.io.Text val)

Returns:

this

setValue

public FluoKeyValueGenerator setValue(Bytes val)

Returns:

this

setValue

public FluoKeyValueGenerator setValue(String val)

This method will use UTF-8 to encode the string as bytes.

Returns:

this

set

public FluoKeyValueGenerator set(RowColumnValue rcv)

Set the row, column, and value

Returns:

this

getKeyValues

public FluoKeyValue[] getKeyValues()

Translates the Fluo row, column, and value set into the persistent format that is stored in Accumulo.

The objects returned by this method are reused each time its called. So each time this is called it invalidates what was returned by previous calls to this method.

Returns:

A an array of Accumulo key values in correct sorted order.