org.apache.hudi.common.util.queue

Class DisruptorMessageQueue<I,O>

java.lang.Object

org.apache.hudi.common.util.queue.DisruptorMessageQueue<I,O>

Type Parameters:

I - Input type.

O - Transformed output type.

All Implemented Interfaces:

Closeable, AutoCloseable, HoodieMessageQueue<I,O>

public class DisruptorMessageQueue<I,O>
extends Object
implements HoodieMessageQueue<I,O>

Implementation of HoodieMessageQueue based on Disruptor Queue.

Constructor Summary

Constructors

Constructor and Description
DisruptorMessageQueue(int bufferSize, Function<I,O> transformFunction, String waitStrategyId, int totalProducers, Runnable preExecuteRunnable)

Method Summary

Modifier and Type	Method and Description
void	close() Shuts down the queue, cleaning up the resources
Throwable	getThrowable()
void	insertRecord(I value) Insert a record into inner message queue.
boolean	isEmpty()
void	markAsFailed(Throwable e) API to allow producers and consumer to communicate termination due to failure.
Option<O>	readNextRecord() Read records from inner message queue.
void	seal() Seals the queue (for writing) preventing new records to be enqueued
protected void	setHandlers(HoodieConsumer<O,?> consumer)
long	size() Returns the number of elements in this queue.
protected void	start()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DisruptorMessageQueue

public DisruptorMessageQueue(int bufferSize,
                             Function<I,O> transformFunction,
                             String waitStrategyId,
                             int totalProducers,
                             Runnable preExecuteRunnable)

Method Detail

size

public long size()

Description copied from interface: HoodieMessageQueue

Returns the number of elements in this queue.

Specified by:

size in interface HoodieMessageQueue<I,O>

insertRecord

public void insertRecord(I value)
                  throws Exception

Description copied from interface: HoodieMessageQueue

Insert a record into inner message queue.

Specified by:

insertRecord in interface HoodieMessageQueue<I,O>

Throws:

Exception

readNextRecord

public Option<O> readNextRecord()

Description copied from interface: HoodieMessageQueue

Read records from inner message queue.

Specified by:

readNextRecord in interface HoodieMessageQueue<I,O>

markAsFailed

public void markAsFailed(Throwable e)

Description copied from interface: HoodieMessageQueue

API to allow producers and consumer to communicate termination due to failure.

Specified by:

markAsFailed in interface HoodieMessageQueue<I,O>

getThrowable

public Throwable getThrowable()

Specified by:

getThrowable in interface HoodieMessageQueue<I,O>

isEmpty

public boolean isEmpty()

Specified by:

isEmpty in interface HoodieMessageQueue<I,O>

seal

public void seal()

Description copied from interface: HoodieMessageQueue

Seals the queue (for writing) preventing new records to be enqueued

Specified by:

seal in interface HoodieMessageQueue<I,O>

close

public void close()

Description copied from interface: HoodieMessageQueue

Shuts down the queue, cleaning up the resources

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in interface HoodieMessageQueue<I,O>

setHandlers

protected void setHandlers(HoodieConsumer<O,?> consumer)

start

protected void start()