org.apache.hudi.common.util.queue

Class DisruptorExecutor<I,O,E>

java.lang.Object

org.apache.hudi.common.util.queue.BaseHoodieQueueBasedExecutor<I,O,E>

org.apache.hudi.common.util.queue.DisruptorExecutor<I,O,E>

All Implemented Interfaces:

HoodieExecutor<E>

public class DisruptorExecutor<I,O,E>
extends BaseHoodieQueueBasedExecutor<I,O,E>

Executor which orchestrates concurrent producers and consumers communicating through 'DisruptorMessageQueue'. This class takes as queue producer(s), consumer and transformer and exposes API to orchestrate concurrent execution of these actors communicating through disruptor

Field Summary

Fields inherited from class org.apache.hudi.common.util.queue.BaseHoodieQueueBasedExecutor

consumer, queue

Constructor Summary

Constructors

Constructor and Description
DisruptorExecutor(Integer bufferSize, Iterator<I> inputItr, HoodieConsumer<O,E> consumer, Function<I,O> transformFunction, String waitStrategy, Runnable preExecuteRunnable)
DisruptorExecutor(int bufferSize, List<HoodieProducer<I>> producers, HoodieConsumer<O,E> consumer, Function<I,O> transformFunction, String waitStrategyId, Runnable preExecuteRunnable)

Method Summary

Modifier and Type	Method and Description
protected void	doConsume(HoodieMessageQueue<I,O> queue, HoodieConsumer<O,E> consumer)
protected void	setUp()

Methods inherited from class org.apache.hudi.common.util.queue.BaseHoodieQueueBasedExecutor

awaitTermination, doProduce, execute, isRunning, shutdownNow, startProducingAsync

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DisruptorExecutor

public DisruptorExecutor(Integer bufferSize,
                         Iterator<I> inputItr,
                         HoodieConsumer<O,E> consumer,
                         Function<I,O> transformFunction,
                         String waitStrategy,
                         Runnable preExecuteRunnable)

DisruptorExecutor

public DisruptorExecutor(int bufferSize,
                         List<HoodieProducer<I>> producers,
                         HoodieConsumer<O,E> consumer,
                         Function<I,O> transformFunction,
                         String waitStrategyId,
                         Runnable preExecuteRunnable)

Method Detail

setUp

protected void setUp()

Overrides:

setUp in class BaseHoodieQueueBasedExecutor<I,O,E>

doConsume

protected void doConsume(HoodieMessageQueue<I,O> queue,
                         HoodieConsumer<O,E> consumer)

Specified by:

doConsume in class BaseHoodieQueueBasedExecutor<I,O,E>