Package org.apache.flink.runtime.checkpoint.metadata

Class MetadataV3Serializer

java.lang.Object

org.apache.flink.runtime.checkpoint.metadata.MetadataV2V3SerializerBase

org.apache.flink.runtime.checkpoint.metadata.MetadataV3Serializer

All Implemented Interfaces:

org.apache.flink.core.io.Versioned, MetadataSerializer

Direct Known Subclasses:

MetadataV4Serializer

@Internal
public class MetadataV3Serializer
extends MetadataV2V3SerializerBase
implements MetadataSerializer

(De)serializer for checkpoint metadata format version 3. This format was introduced with Apache Flink 1.11.0.

Compared to format version 2, this drops some unused fields and introduces operator coordinator state.

See MetadataV2V3SerializerBase for a description of the format layout.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.runtime.checkpoint.metadata.MetadataV2V3SerializerBase

MetadataV2V3SerializerBase.DeserializationContext

Field Summary

Fields

Modifier and Type	Field	Description
static MetadataV3Serializer	INSTANCE	The singleton instance of the serializer.
static int	VERSION	The metadata format version.

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	MetadataV3Serializer()	Singleton, not meant to be instantiated.

Method Summary

Modifier and Type	Method	Description
CheckpointMetadata	deserialize(DataInputStream dis, ClassLoader classLoader, String externalPointer)	Deserializes a savepoint from an input stream.
StateObjectCollection<InputStateHandle>	deserializeInputStateHandle(DataInputStream dis)
StateObjectCollection<InputStateHandle>	deserializeInputStateHandle(DataInputStream dis, MetadataV2V3SerializerBase.DeserializationContext context)
KeyedStateHandle	deserializeKeyedStateHandleUtil(DataInputStream dis)
protected OperatorState	deserializeOperatorState(DataInputStream dis, MetadataV2V3SerializerBase.DeserializationContext context)
OperatorStateHandle	deserializeOperatorStateHandleUtil(DataInputStream dis)
StateObjectCollection<OutputStateHandle>	deserializeOutputStateHandle(DataInputStream dis)
StateObjectCollection<OutputStateHandle>	deserializeOutputStateHandle(DataInputStream dis, MetadataV2V3SerializerBase.DeserializationContext context)
static StreamStateHandle	deserializeStreamStateHandle(DataInputStream dis)
protected org.apache.flink.runtime.checkpoint.metadata.MetadataV3Serializer.SubtaskAndFinishedState	deserializeSubtaskIndexAndFinishedState(DataInputStream dis)
protected org.apache.flink.runtime.checkpoint.metadata.ChannelStateHandleSerializer	getChannelStateHandleSerializer()
int	getVersion()
void	serialize(CheckpointMetadata checkpointMetadata, DataOutputStream dos)	Serializes a savepoint or checkpoint metadata to an output stream.
void	serializeInputStateHandle(InputStateHandle handle, DataOutputStream dos)
void	serializeKeyedStateHandleUtil(KeyedStateHandle stateHandle, DataOutputStream dos)
protected void	serializeOperatorState(OperatorState operatorState, DataOutputStream dos)
void	serializeOperatorStateHandleUtil(OperatorStateHandle stateHandle, DataOutputStream dos)
void	serializeOutputStateHandle(OutputStateHandle handle, DataOutputStream dos)
static void	serializeStreamStateHandle(StreamStateHandle stateHandle, DataOutputStream dos)
protected void	serializeSubtaskState(OperatorSubtaskState subtaskState, DataOutputStream dos)

Methods inherited from class org.apache.flink.runtime.checkpoint.metadata.MetadataV2V3SerializerBase

deserializeMasterState, deserializeMetadata, deserializeSubtaskState, serializeMasterState, serializeMetadata

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

VERSION

public static final int VERSION

The metadata format version.

See Also:

Constant Field Values

INSTANCE

public static final MetadataV3Serializer INSTANCE

The singleton instance of the serializer.

Constructor Detail

MetadataV3Serializer

protected MetadataV3Serializer()

Singleton, not meant to be instantiated.

Method Detail

getVersion

public int getVersion()

Specified by:

getVersion in interface org.apache.flink.core.io.Versioned

serialize

public void serialize(CheckpointMetadata checkpointMetadata,
                      DataOutputStream dos)
               throws IOException

Description copied from interface: MetadataSerializer

Serializes a savepoint or checkpoint metadata to an output stream.

Specified by:

serialize in interface MetadataSerializer

Throws:

IOException - Serialization failures are forwarded

deserialize

public CheckpointMetadata deserialize(DataInputStream dis,
                                      ClassLoader classLoader,
                                      String externalPointer)
                               throws IOException

Description copied from interface: MetadataSerializer

Deserializes a savepoint from an input stream.

Specified by:

deserialize in interface MetadataSerializer

Parameters:

dis - Input stream to deserialize savepoint from

classLoader - the user code class loader

externalPointer - the external pointer of the given checkpoint

Returns:

The deserialized savepoint

Throws:

IOException - Serialization failures are forwarded

serializeOperatorState

protected void serializeOperatorState(OperatorState operatorState,
                                      DataOutputStream dos)
                               throws IOException

Specified by:

serializeOperatorState in class MetadataV2V3SerializerBase

Throws:

IOException

serializeSubtaskState

protected void serializeSubtaskState(OperatorSubtaskState subtaskState,
                                     DataOutputStream dos)
                              throws IOException

Overrides:

serializeSubtaskState in class MetadataV2V3SerializerBase

Throws:

IOException

deserializeOperatorState

protected OperatorState deserializeOperatorState(DataInputStream dis,
                                                 @Nullable
                                                 MetadataV2V3SerializerBase.DeserializationContext context)
                                          throws IOException

Specified by:

deserializeOperatorState in class MetadataV2V3SerializerBase

Throws:

IOException

deserializeSubtaskIndexAndFinishedState

protected org.apache.flink.runtime.checkpoint.metadata.MetadataV3Serializer.SubtaskAndFinishedState deserializeSubtaskIndexAndFinishedState(DataInputStream dis)
                                                                                                                                     throws IOException

Throws:

IOException

getChannelStateHandleSerializer

protected org.apache.flink.runtime.checkpoint.metadata.ChannelStateHandleSerializer getChannelStateHandleSerializer()

serializeOutputStateHandle

@VisibleForTesting
public void serializeOutputStateHandle(OutputStateHandle handle,
                                       DataOutputStream dos)
                                throws IOException

Overrides:

serializeOutputStateHandle in class MetadataV2V3SerializerBase

Throws:

IOException

deserializeOutputStateHandle

public StateObjectCollection<OutputStateHandle> deserializeOutputStateHandle(DataInputStream dis,
                                                                             @Nullable
                                                                             MetadataV2V3SerializerBase.DeserializationContext context)
                                                                      throws IOException

Overrides:

deserializeOutputStateHandle in class MetadataV2V3SerializerBase

Throws:

IOException

serializeInputStateHandle

@VisibleForTesting
public void serializeInputStateHandle(InputStateHandle handle,
                                      DataOutputStream dos)
                               throws IOException

Overrides:

serializeInputStateHandle in class MetadataV2V3SerializerBase

Throws:

IOException

deserializeInputStateHandle

public StateObjectCollection<InputStateHandle> deserializeInputStateHandle(DataInputStream dis,
                                                                           @Nullable
                                                                           MetadataV2V3SerializerBase.DeserializationContext context)
                                                                    throws IOException

Overrides:

deserializeInputStateHandle in class MetadataV2V3SerializerBase

Throws:

IOException

serializeStreamStateHandle

@VisibleForTesting
public static void serializeStreamStateHandle(StreamStateHandle stateHandle,
                                              DataOutputStream dos)
                                       throws IOException

Throws:

IOException

deserializeStreamStateHandle

@VisibleForTesting
public static StreamStateHandle deserializeStreamStateHandle(DataInputStream dis)
                                                      throws IOException

Throws:

IOException

serializeOperatorStateHandleUtil

@VisibleForTesting
public void serializeOperatorStateHandleUtil(OperatorStateHandle stateHandle,
                                             DataOutputStream dos)
                                      throws IOException

Throws:

IOException

deserializeOperatorStateHandleUtil

@VisibleForTesting
public OperatorStateHandle deserializeOperatorStateHandleUtil(DataInputStream dis)
                                                       throws IOException

Throws:

IOException

serializeKeyedStateHandleUtil

@VisibleForTesting
public void serializeKeyedStateHandleUtil(KeyedStateHandle stateHandle,
                                          DataOutputStream dos)
                                   throws IOException

Throws:

IOException

deserializeKeyedStateHandleUtil

@VisibleForTesting
public KeyedStateHandle deserializeKeyedStateHandleUtil(DataInputStream dis)
                                                 throws IOException

Throws:

IOException

deserializeInputStateHandle

@VisibleForTesting
public StateObjectCollection<InputStateHandle> deserializeInputStateHandle(DataInputStream dis)
                                                                    throws IOException

Throws:

IOException

deserializeOutputStateHandle

@VisibleForTesting
public StateObjectCollection<OutputStateHandle> deserializeOutputStateHandle(DataInputStream dis)
                                                                      throws IOException

Throws:

IOException