net.fortytwo.stream.sparql

Class RDFStreamProcessor<C,Q>

java.lang.Object

net.fortytwo.stream.BasicStreamProcessor<String,C,Q,org.openrdf.model.Statement,org.openrdf.query.BindingSet>

net.fortytwo.stream.sparql.RDFStreamProcessor<C,Q>

All Implemented Interfaces:

StreamProcessor<String,org.openrdf.model.Statement,org.openrdf.query.BindingSet>

Direct Known Subclasses:

SparqlStreamProcessor

public abstract class RDFStreamProcessor<C,Q>
extends BasicStreamProcessor<String,C,Q,org.openrdf.model.Statement,org.openrdf.query.BindingSet>

A base class for streaming SPARQL 1.1 implementations. Optionally, performance data is generated in the process of query processing.

Author:

Joshua Shinavier (http://fortytwo.net)

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	RDFStreamProcessor.Counter
static class	RDFStreamProcessor.Quantity

Nested classes/interfaces inherited from interface net.fortytwo.stream.StreamProcessor

StreamProcessor.IncompatibleQueryException, StreamProcessor.InvalidQueryException

Field Summary

Fields

Modifier and Type	Field and Description
protected static Logger	logger

Fields inherited from interface net.fortytwo.stream.StreamProcessor

INFINITE_TTL, NEVER_EXPIRE

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	RDFStreamProcessor()

Method Summary

Modifier and Type	Method and Description
boolean	addInputs(int ttl, org.openrdf.model.Statement... inputs)
Subscription	addQuery(int ttl, String queryStr, java.util.function.BiConsumer<org.openrdf.query.BindingSet,Long> consumer)
protected Subscription	addQueryNative(int ttl, C sparqlQuery, java.util.function.BiConsumer<org.openrdf.query.BindingSet,Long> consumer)
protected abstract boolean	addTuple(org.openrdf.model.Value[] tuple, int ttl, long now) Adds a tuple to an internal index, possibly generating new solutions
protected long	beginOperation()
protected void	clearCounters()
protected abstract BasicSubscription<C,Q,org.openrdf.query.BindingSet>	createSubscription(int ttl, C sparqlQuery, java.util.function.BiConsumer<org.openrdf.query.BindingSet,Long> consumer)
long	get(RDFStreamProcessor.Quantity quantity) Retrieves a quantity tracked when "performance metrics" are enabled
protected long	getNow()
protected void	handleSolution(java.util.function.BiConsumer<org.openrdf.query.BindingSet,Long> consumer, org.openrdf.query.BindingSet solution, long expirationTime)
protected void	increment(RDFStreamProcessor.Counter counter, boolean logChange)
protected void	incrementQueries()
protected void	incrementSolutions()
protected void	incrementStatements()
protected boolean	isActive()
protected void	logEntry()
protected void	logHeader()
protected abstract C	parseQuery(String queryStr)
void	setClock(java.util.function.Supplier<Long> clock)
void	setDoPerformanceMetrics(boolean b)
void	setDoUseCompactLogFormat(boolean b)
void	shutDown()
protected long	toExpirationTime(int ttl, long now)

Methods inherited from class net.fortytwo.stream.BasicStreamProcessor

renew, unregister

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface net.fortytwo.stream.StreamProcessor

clear

Field Detail

logger

protected static final Logger logger

Constructor Detail

RDFStreamProcessor

protected RDFStreamProcessor()

Method Detail

isActive

protected boolean isActive()

shutDown

public void shutDown()

parseQuery

protected abstract C parseQuery(String queryStr)
                         throws StreamProcessor.InvalidQueryException,
                                StreamProcessor.IncompatibleQueryException

Throws:

StreamProcessor.InvalidQueryException

StreamProcessor.IncompatibleQueryException

createSubscription

protected abstract BasicSubscription<C,Q,org.openrdf.query.BindingSet> createSubscription(int ttl,
                                                                                          C sparqlQuery,
                                                                                          java.util.function.BiConsumer<org.openrdf.query.BindingSet,Long> consumer)

addTuple

protected abstract boolean addTuple(org.openrdf.model.Value[] tuple,
                                    int ttl,
                                    long now)

Adds a tuple to an internal index, possibly generating new solutions

Parameters:

tuple - the tuple to add

ttl - the time-to-live in seconds

now - the current time in milliseconds

Returns:

whether the addition of the tuple changed the state of the index

setClock

public void setClock(java.util.function.Supplier<Long> clock)

setDoUseCompactLogFormat

public void setDoUseCompactLogFormat(boolean b)

Parameters:

b - whether performance metadata (if enabled) should be output only when new solutions are computed, and not every time a statement is added. This makes the log much smaller.

setDoPerformanceMetrics

public void setDoPerformanceMetrics(boolean b)

Parameters:

b - whether to output performance metadata as new statements are added to the query engine and solutions are found If enabled, this allows fine details query latency and throughput, memory usage, and other performance variables to be studied.

addQuery

public Subscription addQuery(int ttl,
                             String queryStr,
                             java.util.function.BiConsumer<org.openrdf.query.BindingSet,Long> consumer)
                      throws StreamProcessor.IncompatibleQueryException,
                             StreamProcessor.InvalidQueryException,
                             IOException

Throws:

StreamProcessor.IncompatibleQueryException

StreamProcessor.InvalidQueryException

IOException

addQueryNative

protected Subscription addQueryNative(int ttl,
                                      C sparqlQuery,
                                      java.util.function.BiConsumer<org.openrdf.query.BindingSet,Long> consumer)
                               throws IOException

Throws:

IOException

get

public long get(RDFStreamProcessor.Quantity quantity)

Retrieves a quantity tracked when "performance metrics" are enabled

Parameters:

quantity - the quantity to retrieve

Returns:

the current value of the retrieved quantity

addInputs

public boolean addInputs(int ttl,
                         org.openrdf.model.Statement... inputs)

increment

protected void increment(RDFStreamProcessor.Counter counter,
                         boolean logChange)

incrementQueries

protected void incrementQueries()

incrementStatements

protected void incrementStatements()

incrementSolutions

protected void incrementSolutions()

beginOperation

protected long beginOperation()

getNow

protected long getNow()

logEntry

protected void logEntry()

logHeader

protected void logHeader()

toExpirationTime

protected long toExpirationTime(int ttl,
                                long now)

handleSolution

protected void handleSolution(java.util.function.BiConsumer<org.openrdf.query.BindingSet,Long> consumer,
                              org.openrdf.query.BindingSet solution,
                              long expirationTime)

clearCounters

protected void clearCounters()