de.l3s.icrawl.contentanalysis

Class WebPageDateExtractor

java.lang.Object

de.l3s.icrawl.contentanalysis.WebPageDateExtractor

public class WebPageDateExtractor
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WebPageDateExtractor.DateSource
static class	WebPageDateExtractor.ExtractionException
static class	WebPageDateExtractor.WebPageDate

Constructor Summary

Constructors

Constructor and Description
WebPageDateExtractor()

Method Summary

Modifier and Type	Method and Description
static WebPageDateExtractor.WebPageDate	extractModifiedDate(org.jsoup.nodes.Document dom) Extract the likely modification date from a parsed document.
static WebPageDateExtractor.WebPageDate	getModifiedDate(String url, org.jsoup.nodes.Document document, Long httpModifiedTime, org.apache.hadoop.mapreduce.Mapper.Context context)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WebPageDateExtractor

public WebPageDateExtractor()

Method Detail

extractModifiedDate

public static WebPageDateExtractor.WebPageDate extractModifiedDate(org.jsoup.nodes.Document dom)
                                                            throws InterruptedException

Extract the likely modification date from a parsed document.

Parameters:

dom - DOM tree of an HTML document

Returns:

the modification date or null

Throws:

InterruptedException

getModifiedDate

public static WebPageDateExtractor.WebPageDate getModifiedDate(String url,
                                                               org.jsoup.nodes.Document document,
                                                               Long httpModifiedTime,
                                                               org.apache.hadoop.mapreduce.Mapper.Context context)
                                                        throws InterruptedException

Throws:

InterruptedException