| Package | Description |
|---|---|
| org.apache.hudi.common.util.queue |
| Class and Description |
|---|
| BaseHoodieQueueBasedExecutor
Base class for multi-threaded queue-based executor which
Can be ingesting instances of type
I from multiple HoodieProducers
into the HoodieMessageQueue
Can be ingesting instances of type I into an (optional) HoodieConsumer
from the internal HoodieMessageQueue (when no consumer is provided records are
simply accumulated into internal queue)
Such executors are allowing to setup an ingestion pipeline w/ N:1 configuration, where data
is ingested from multiple sources (ie producers) into a singular sink (ie consumer), using
an internal queue to stage the records ingested from producers before these are consumed |
| DisruptorWaitStrategyType
Enum for the type of waiting strategy in Disruptor Queue.
|
| ExecutorType
Types of
HoodieExecutor. |
| HoodieConsumer
HoodieConsumer is used to consume records/messages from hoodie inner message queue and write into DFS.
|
| HoodieExecutor
HoodieExecutor which orchestrates concurrent producers and consumers communicating.
|
| HoodieMessageQueue
HoodieMessageQueue holds an internal message queue, and control the behavior of
1.
|
| HoodieProducer
Producer for
HoodieMessageQueue. |
Copyright © 2024 The Apache Software Foundation. All rights reserved.