org.apache.kafka.connect.tools

Class VerifiableSinkTask

java.lang.Object

org.apache.kafka.connect.sink.SinkTask

org.apache.kafka.connect.tools.VerifiableSinkTask

All Implemented Interfaces:

org.apache.kafka.connect.connector.Task

public class VerifiableSinkTask
extends org.apache.kafka.connect.sink.SinkTask

Counterpart to VerifiableSourceTask that consumes records and logs information about each to stdout. This allows validation of processing of messages by sink tasks on distributed workers even in the face of worker restarts and failures. This task relies on the offset management provided by the Kafka Connect framework and therefore can detect bugs in its implementation.

Field Summary

Fields

Modifier and Type	Field and Description
static String	ID_CONFIG
static String	NAME_CONFIG

Fields inherited from class org.apache.kafka.connect.sink.SinkTask

TOPICS_CONFIG, TOPICS_REGEX_CONFIG

Constructor Summary

Constructors

Constructor and Description
VerifiableSinkTask()

Method Summary

Modifier and Type	Method and Description
void	flush(Map<org.apache.kafka.common.TopicPartition,org.apache.kafka.clients.consumer.OffsetAndMetadata> offsets)
void	put(Collection<org.apache.kafka.connect.sink.SinkRecord> records)
void	start(Map<String,String> props)
void	stop()
String	version()

Methods inherited from class org.apache.kafka.connect.sink.SinkTask

close, initialize, onPartitionsAssigned, onPartitionsRevoked, open, preCommit

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NAME_CONFIG

public static final String NAME_CONFIG

See Also:

Constant Field Values

ID_CONFIG

public static final String ID_CONFIG

See Also:

Constant Field Values

Constructor Detail

VerifiableSinkTask

public VerifiableSinkTask()

Method Detail

version

public String version()

start

public void start(Map<String,String> props)

Specified by:

start in interface org.apache.kafka.connect.connector.Task

Specified by:

start in class org.apache.kafka.connect.sink.SinkTask

put

public void put(Collection<org.apache.kafka.connect.sink.SinkRecord> records)

Specified by:

put in class org.apache.kafka.connect.sink.SinkTask

flush

public void flush(Map<org.apache.kafka.common.TopicPartition,org.apache.kafka.clients.consumer.OffsetAndMetadata> offsets)

Overrides:

flush in class org.apache.kafka.connect.sink.SinkTask

stop

public void stop()

Specified by:

stop in interface org.apache.kafka.connect.connector.Task

Specified by:

stop in class org.apache.kafka.connect.sink.SinkTask