org.apache.drill.exec.store.httpd

Class HttpdParser

java.lang.Object

org.apache.drill.exec.store.httpd.HttpdParser

public class HttpdParser
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
static HashMap<String,String>	LOGFIELDS
static String	PARSER_WILDCARD
static String	REMAPPING_FLAG
static String	SAFE_SEPARATOR
static String	SAFE_WILDCARD

Constructor Summary

Constructors

Constructor and Description
HttpdParser(BaseWriter.MapWriter mapWriter, DrillBuf managedBuffer, String logFormat, String timestampFormat, Map<String,String> fieldMapping)

Method Summary

Methods

Modifier and Type	Method and Description
static String	drillFormattedFieldName(String parserFieldName) Drill cannot deal with fields with dots in them like request.referer.
void	parse(String line) We do not expose the underlying parser or the record which is used to manage the writers.
static String	parserFormattedFieldName(String drillFieldName) The parser deals with dots unlike Drill wanting underscores request_referer.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PARSER_WILDCARD

public static final String PARSER_WILDCARD

See Also:

Constant Field Values

SAFE_WILDCARD

public static final String SAFE_WILDCARD

See Also:

Constant Field Values

SAFE_SEPARATOR

public static final String SAFE_SEPARATOR

See Also:

Constant Field Values

REMAPPING_FLAG

public static final String REMAPPING_FLAG

See Also:

Constant Field Values

LOGFIELDS

public static final HashMap<String,String> LOGFIELDS

Constructor Detail

HttpdParser

public HttpdParser(BaseWriter.MapWriter mapWriter,
           DrillBuf managedBuffer,
           String logFormat,
           String timestampFormat,
           Map<String,String> fieldMapping)
            throws NoSuchMethodException,
                   nl.basjes.parse.core.exceptions.MissingDissectorsException,
                   nl.basjes.parse.core.exceptions.InvalidDissectorException

Throws:

NoSuchMethodException

nl.basjes.parse.core.exceptions.MissingDissectorsException

nl.basjes.parse.core.exceptions.InvalidDissectorException

Method Detail

parse

public void parse(String line)
           throws nl.basjes.parse.core.exceptions.DissectionFailure,
                  nl.basjes.parse.core.exceptions.InvalidDissectorException,
                  nl.basjes.parse.core.exceptions.MissingDissectorsException

We do not expose the underlying parser or the record which is used to manage the writers.

Parameters:

line - log line to tear apart.

Throws:

nl.basjes.parse.core.exceptions.DissectionFailure

nl.basjes.parse.core.exceptions.InvalidDissectorException

nl.basjes.parse.core.exceptions.MissingDissectorsException

parserFormattedFieldName

public static String parserFormattedFieldName(String drillFieldName)

The parser deals with dots unlike Drill wanting underscores request_referer. For the sake of simplicity we are going replace the dots. The resultant output field will look like: request.referer.
Additionally, wild cards will get replaced with .*

Parameters:

drillFieldName - name to be cleansed.

Returns:

drillFormattedFieldName

public static String drillFormattedFieldName(String parserFieldName)

Drill cannot deal with fields with dots in them like request.referer. For the sake of simplicity we are going ensure the field name is cleansed. The resultant output field will look like: request_referer.
Additionally, wild cards will get replaced with _$

Parameters:

parserFieldName - name to be cleansed.

Returns: