Package org.apache.hop.pipeline.transforms.streamlookup

Class StreamLookup

  • All Implemented Interfaces:
    IExtensionData, IHasLogChannel, ILoggingObject, IVariables, org.apache.hop.pipeline.engine.IEngineComponent, org.apache.hop.pipeline.transform.ITransform
    public class StreamLookup
extends org.apache.hop.pipeline.transform.BaseTransform<StreamLookupMeta,​StreamLookupData>
    Looks up information by first reading data into a hash table (in memory)

    TODO: add warning with conflicting types OR modify the lookup values to the input row type. (this is harder to do as currently we don't know the types)

    • Field Summary

      • Fields inherited from class org.apache.hop.pipeline.transform.BaseTransform

        data, deadLockCounter, executionEndDate, executionStartDate, extensionDataMap, first, firstRowReadDate, initStartDate, lastRowWrittenDate, log, meta, metadataProvider, rowListeners, safeStopped, terminator, terminatorRows, variables

    • Constructor Summary

      Constructors 
      Constructor Description
      StreamLookup​(org.apache.hop.pipeline.transform.TransformMeta transformMeta, StreamLookupMeta meta, StreamLookupData data, int copyNr, org.apache.hop.pipeline.PipelineMeta pipelineMeta, org.apache.hop.pipeline.Pipeline pipeline)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void dispose()  
      boolean init()  
      boolean processRow()  

      • Methods inherited from class org.apache.hop.pipeline.transform.BaseTransform

        addResultFile, addRowListener, addRowSetToInputRowSets, addRowSetToOutputRowSets, addTransformFinishedListener, addTransformStartedListener, batchComplete, canProcessOneRow, checkFeedback, cleanup, clearInputRowSets, clearOutputRowSets, closeQuietly, copyFrom, decrementLinesRead, decrementLinesWritten, dispatch, findInputRowSet, findInputRowSet, findOutputRowSet, findOutputRowSet, finishBundle, getContainerId, getCopy, getCopyNr, getCurrentInputRowSetNr, getCurrentOutputRowSetNr, getData, getDispatcher, getErrorRowMeta, getErrors, getExecutionDuration, getExecutionEndDate, getExecutionStartDate, getExtensionDataMap, getFilename, getFirstInputRowSet, getFirstRowReadDate, getInitStartDate, getInputBufferSize, getInputRowMeta, getInputRowSets, getLastRowWrittenDate, getLinesInput, getLinesOutput, getLinesRead, getLinesRejected, getLinesSkipped, getLinesUpdated, getLinesWritten, getLogChannel, getLogChannelId, getLogLevel, getLogText, getMeta, getMetadataProvider, getName, getObjectCopy, getObjectName, getObjectType, getOutputBufferSize, getOutputRowSets, getParent, getParentVariables, getPartitionId, getPartitionTargets, getPipeline, getPipelineMeta, getPreviewRowMeta, getProcessed, getRegistrationDate, getRepartitioning, getResultFiles, getRow, getRowFrom, getRowHandler, getRowListeners, getStatus, getStatusDescription, getTransformFinishedListeners, getTransformMeta, getTransformName, getTransformPluginId, getTransformStartedListeners, getVariable, getVariable, getVariableBoolean, getVariableNames, handleGetRowFrom, handlePutError, handlePutRowTo, identifyErrorOutput, incrementLinesInput, incrementLinesOutput, incrementLinesRead, incrementLinesRejected, incrementLinesSkipped, incrementLinesUpdated, incrementLinesWritten, initBeforeStart, initializeFrom, isAllowEmptyFieldNamesAndTypes, isBasic, isDebug, isDetailed, isDistributed, isForcingSeparateLogging, isGatheringMetrics, isInitialising, isMapping, isPartitioned, isPaused, isRowLevel, isRunning, isSafeStopped, isSelected, isStopped, logBasic, logBasic, logDebug, logDebug, logDetailed, logDetailed, logError, logError, logError, logMinimal, logMinimal, logRowlevel, logRowlevel, logSummary, markStart, markStop, outputIsDone, pauseRunning, putError, putRow, putRowTo, removeRowListener, resolve, resolve, resolve, resumeRunning, rowsetInputSize, rowsetOutputSize, safeModeChecking, safeModeChecking, setAllowEmptyFieldNamesAndTypes, setCarteObjectId, setCopy, setCopyNr, setCurrentInputRowSetNr, setCurrentOutputRowSetNr, setDistributed, setErrorRowMeta, setErrors, setExecutionEndDate, setExecutionStartDate, setFirstRowReadDate, setForcingSeparateLogging, setGatheringMetrics, setInitStartDate, setInputRowMeta, setInputRowSets, setInternalVariables, setLastRowWrittenDate, setLinesInput, setLinesOutput, setLinesRead, setLinesRejected, setLinesSkipped, setLinesUpdated, setLinesWritten, setLogLevel, setMetadataProvider, setOutputDone, setOutputRowSets, setParentVariables, setPartitioned, setPartitionId, setPartitionTargets, setPaused, setPaused, setPreviewRowMeta, setRepartitioning, setRowHandler, setRunning, setSafeStopped, setStopped, setTransformFinishedListeners, setTransformName, setTransformStartedListeners, setVariable, setVariables, shareWith, startBundle, stopAll, stopRunning, swapFirstInputRowSetIfExists, toString, waitUntilPipelineIsStarted

      • Methods inherited from interface org.apache.hop.pipeline.transform.ITransform

        subStatuses

    • Constructor Detail

      • StreamLookup

        public StreamLookup​(org.apache.hop.pipeline.transform.TransformMeta transformMeta,
                    StreamLookupMeta meta,
                    StreamLookupData data,
                    int copyNr,
                    org.apache.hop.pipeline.PipelineMeta pipelineMeta,
                    org.apache.hop.pipeline.Pipeline pipeline)

    • Method Detail

      • processRow

        public boolean processRow()
                   throws HopException
        Specified by:
        processRow in interface org.apache.hop.pipeline.transform.ITransform
        Overrides:
        processRow in class org.apache.hop.pipeline.transform.BaseTransform<StreamLookupMeta,​StreamLookupData>
        Throws:
        HopException

      • init

        public boolean init()
        Specified by:
        init in interface org.apache.hop.pipeline.transform.ITransform
        Overrides:
        init in class org.apache.hop.pipeline.transform.BaseTransform<StreamLookupMeta,​StreamLookupData>

      • dispose

        public void dispose()
        Specified by:
        dispose in interface org.apache.hop.pipeline.transform.ITransform
        Overrides:
        dispose in class org.apache.hop.pipeline.transform.BaseTransform<StreamLookupMeta,​StreamLookupData>