de.citec.scie.pdf

Class DocumentBlockCleaner

java.lang.Object

de.citec.scie.pdf.DocumentBlockCleaner

public class DocumentBlockCleaner
extends Object

Author:

Benjamin Paassen - bpaassen(at)techfak.uni-bielefeld.de

Field Summary

Fields

Modifier and Type	Field and Description
static double	REMOVETHRESHOLD
static int	SMALLBLOCKSIZE

Constructor Summary

Constructors

Constructor and Description
DocumentBlockCleaner()

Method Summary

Modifier and Type	Method and Description
void	blockCleanup(Document doc) The cleanup is done using a greedy heuristic as follows: Start with short text blocks on the first page and than iterate over all other pages and try to build a sequence of most similar TextBlocks to it.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SMALLBLOCKSIZE

public static final int SMALLBLOCKSIZE

See Also:

Constant Field Values

REMOVETHRESHOLD

public static final double REMOVETHRESHOLD

See Also:

Constant Field Values

Constructor Detail

DocumentBlockCleaner

public DocumentBlockCleaner()

Method Detail

blockCleanup

public void blockCleanup(Document doc)

The cleanup is done using a greedy heuristic as follows: Start with short text blocks on the first page and than iterate over all other pages and try to build a sequence of most similar TextBlocks to it. If we find a similar TextBlock on all (or at least most) pages, the information is redundant and we can exclude those TextBlocks from the document.

Parameters:

doc - a document.