Package io.debezium.pipeline.source.snapshot.chunked

Class ChunkBoundaryCalculator

java.lang.Object

io.debezium.pipeline.source.snapshot.chunked.ChunkBoundaryCalculator

public class ChunkBoundaryCalculator
extends Object

Calculates chunk boundaries for chunked table snapshots.

Author:

Chris Cranford

Field Summary

Fields

Modifier and Type	Field	Description
private final JdbcConnection	jdbcConnection
private static final org.slf4j.Logger	LOGGER

Constructor Summary

Constructors

Constructor	Description
ChunkBoundaryCalculator(JdbcConnection jdbcConnection)

Method Summary

Modifier and Type	Method	Description
List<Object[]>	calculateBoundaries(Table table, List<Column> keyColumns, OptionalLong rowCount, int numChunks)	Calculate chunk boundaries for a table.
Object[]	calculateMaxKey(Table table, List<Column> keyColumns)
List<SnapshotChunk>	createChunks(Table table, List<Object[]> boundaries, int tableOrder, int tableCount, String baseSelectStatement, OptionalLong totalRowCount, Object[] maximumKey)	Create SnapshotChunk objects from calculated boundaries.
private Object[]	queryBoundaryAtPosition(TableId tableId, String keyColumnNames, List<Column> keyColumns, long position)
private Object[]	queryColumnValues(List<Column> columns, String sql)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

jdbcConnection

private final JdbcConnection jdbcConnection

Constructor Details

ChunkBoundaryCalculator

public ChunkBoundaryCalculator(JdbcConnection jdbcConnection)

Method Details

calculateBoundaries

public List<Object[]> calculateBoundaries(Table table,
 List<Column> keyColumns,
 OptionalLong rowCount,
 int numChunks)
                                   throws SQLException

Calculate chunk boundaries for a table.

Parameters:

table - The table to chunk

keyColumns - The columns to use for chunking (PK or message.key.columns)

rowCount - Estimated row count

numChunks - Desired number of chunks

Returns:

List of boundary value arrays (each array has values for all key columns)

Throws:

SQLException

queryBoundaryAtPosition

private Object[] queryBoundaryAtPosition(TableId tableId,
 String keyColumnNames,
 List<Column> keyColumns,
 long position)
                                  throws SQLException

Throws:

SQLException

createChunks

public List<SnapshotChunk> createChunks(Table table,
 List<Object[]> boundaries,
 int tableOrder,
 int tableCount,
 String baseSelectStatement,
 OptionalLong totalRowCount,
 Object[] maximumKey)

Create SnapshotChunk objects from calculated boundaries.

calculateMaxKey

public Object[] calculateMaxKey(Table table,
 List<Column> keyColumns)
                         throws SQLException

Throws:

SQLException

queryColumnValues

private Object[] queryColumnValues(List<Column> columns,
 String sql)
                            throws SQLException

Throws:

SQLException