org.apache.hadoop.resourceestimator.translator.impl

Class BaseLogParser

java.lang.Object

org.apache.hadoop.resourceestimator.translator.impl.BaseLogParser

All Implemented Interfaces:

AutoCloseable, LogParser

public class BaseLogParser
extends Object
implements LogParser

Base class to implement LogParser. It wraps a SingleLineParser from the Configuration to parse a log dir/file.

Constructor Summary

Constructors

Constructor and Description
BaseLogParser()

Method Summary

Methods

Modifier and Type	Method and Description
void	close() Release the resource used by the ParserUtil.
void	init(org.apache.hadoop.conf.Configuration config, HistorySkylineStore skylineStore) Initializing the LogParser, including loading solver parameters from configuration file.
void	parseLine(String logLine, Map<String,JobMetaData> jobMetas, Map<RecurrenceId,List<ResourceSkyline>> skylineRecords)
void	parseStream(InputStream logs) Parses each line in the log stream, and adds extracted ResourceSkylines to the SkylineStore.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BaseLogParser

public BaseLogParser()

Method Detail

init

public void init(org.apache.hadoop.conf.Configuration config,
        HistorySkylineStore skylineStore)
          throws ResourceEstimatorException

Description copied from interface: LogParser

Initializing the LogParser, including loading solver parameters from configuration file.

Specified by:

init in interface LogParser

Parameters:

config - Configuration for the LogParser.

skylineStore - the HistorySkylineStore which stores recurring pipeline's ResourceSkylines.

Throws:

ResourceEstimatorException - if initialization of a SingleLineParser fails.

parseLine

public void parseLine(String logLine,
             Map<String,JobMetaData> jobMetas,
             Map<RecurrenceId,List<ResourceSkyline>> skylineRecords)
               throws DataFieldNotFoundException,
                      ParseException

Throws:

DataFieldNotFoundException

ParseException

parseStream

public final void parseStream(InputStream logs)
                       throws SkylineStoreException,
                              IOException

Description copied from interface: LogParser

Parses each line in the log stream, and adds extracted ResourceSkylines to the SkylineStore.

Specified by:

parseStream in interface LogParser

Parameters:

logs - the stream of input logs.

Throws:

SkylineStoreException - if it fails to addHistory extracted ResourceSkylines to the SkylineStore.

IOException - if it fails to read from the InputStream.

close

public final void close()

Release the resource used by the ParserUtil.

Specified by:

close in interface AutoCloseable

Specified by:

close in interface LogParser