| Package | Description |
|---|---|
| org.apache.hudi.common.util.queue |
| Modifier and Type | Class and Description |
|---|---|
class |
BaseHoodieQueueBasedExecutor<I,O,E>
Base class for multi-threaded queue-based executor which
Can be ingesting instances of type
I from multiple HoodieProducers
into the HoodieMessageQueue
Can be ingesting instances of type I into an (optional) HoodieConsumer
from the internal HoodieMessageQueue (when no consumer is provided records are
simply accumulated into internal queue)
Such executors are allowing to setup an ingestion pipeline w/ N:1 configuration, where data
is ingested from multiple sources (ie producers) into a singular sink (ie consumer), using
an internal queue to stage the records ingested from producers before these are consumed |
class |
BoundedInMemoryExecutor<I,O,E>
Executor which orchestrates concurrent producers and consumers communicating through 'BoundedInMemoryQueue'.
|
class |
DisruptorExecutor<I,O,E>
Executor which orchestrates concurrent producers and consumers communicating through 'DisruptorMessageQueue'.
|
class |
SimpleExecutor<I,O,E>
Simple implementation of the
HoodieExecutor interface assuming single-writer/single-reader
mode allowing it to consume from the input Iterator directly avoiding the need for
any internal materialization (ie queueing). |
Copyright © 2024 The Apache Software Foundation. All rights reserved.