Uses of Interface
org.apache.flink.runtime.io.network.buffer.Buffer

Packages that use Buffer

Package	Description
org.apache.flink.runtime.checkpoint.channel
org.apache.flink.runtime.io.disk
org.apache.flink.runtime.io.disk.iomanager
org.apache.flink.runtime.io.network.api.serialization
org.apache.flink.runtime.io.network.buffer
org.apache.flink.runtime.io.network.logger
org.apache.flink.runtime.io.network.partition
org.apache.flink.runtime.io.network.partition.consumer
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common
org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty
org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory
org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Uses of Buffer in org.apache.flink.runtime.checkpoint.channel

Methods in org.apache.flink.runtime.checkpoint.channel with parameters of type Buffer

Modifier and Type	Method	Description
void	ChannelStateWriter.addOutputData(long checkpointId, ResultSubpartitionInfo info, int startSeqNum, Buffer... data)	Add in-flight buffers from the ResultSubpartition.
void	ChannelStateWriter.NoOpChannelStateWriter.addOutputData(long checkpointId, ResultSubpartitionInfo info, int startSeqNum, Buffer... data)
void	ChannelStateWriterImpl.addOutputData(long checkpointId, ResultSubpartitionInfo info, int startSeqNum, Buffer... data)

Method parameters in org.apache.flink.runtime.checkpoint.channel with type arguments of type Buffer

Modifier and Type	Method	Description
void	ChannelStateWriter.addInputData(long checkpointId, InputChannelInfo info, int startSeqNum, org.apache.flink.util.CloseableIterator<Buffer> data)	Add in-flight buffers from the InputChannel.
void	ChannelStateWriter.NoOpChannelStateWriter.addInputData(long checkpointId, InputChannelInfo info, int startSeqNum, org.apache.flink.util.CloseableIterator<Buffer> data)
void	ChannelStateWriterImpl.addInputData(long checkpointId, InputChannelInfo info, int startSeqNum, org.apache.flink.util.CloseableIterator<Buffer> iterator)
void	ChannelStateWriter.addOutputDataFuture(long checkpointId, ResultSubpartitionInfo info, int startSeqNum, CompletableFuture<List<Buffer>> data)	Add in-flight bufferFuture from the ResultSubpartition.
void	ChannelStateWriter.NoOpChannelStateWriter.addOutputDataFuture(long checkpointId, ResultSubpartitionInfo info, int startSeqNum, CompletableFuture<List<Buffer>> data)
void	ChannelStateWriterImpl.addOutputDataFuture(long checkpointId, ResultSubpartitionInfo info, int startSeqNum, CompletableFuture<List<Buffer>> dataFuture)

Uses of Buffer in org.apache.flink.runtime.io.disk

Methods in org.apache.flink.runtime.io.disk that return Buffer

Modifier and Type	Method	Description
Buffer	FileBasedBufferIterator.next()

Uses of Buffer in org.apache.flink.runtime.io.disk.iomanager

Methods in org.apache.flink.runtime.io.disk.iomanager with parameters of type Buffer

Modifier and Type	Method	Description
boolean	BufferFileChannelReader.readBufferFromFileChannel(Buffer buffer)	Reads data from the object's file channel into the given buffer.
void	AsynchronousBufferFileReader.readInto(Buffer buffer)
void	BufferFileReader.readInto(Buffer buffer)
void	SynchronousBufferFileReader.readInto(Buffer buffer)
void	AsynchronousBufferFileWriter.writeBlock(Buffer buffer)	Writes the given block asynchronously.

Method parameters in org.apache.flink.runtime.io.disk.iomanager with type arguments of type Buffer

Modifier and Type	Method	Description
abstract BufferFileReader	IOManager.createBufferFileReader(FileIOChannel.ID channelID, RequestDoneCallback<Buffer> callback)
BufferFileReader	IOManagerAsync.createBufferFileReader(FileIOChannel.ID channelID, RequestDoneCallback<Buffer> callback)

Constructor parameters in org.apache.flink.runtime.io.disk.iomanager with type arguments of type Buffer

Constructor	Description
AsynchronousBufferFileReader(FileIOChannel.ID channelID, RequestQueue<org.apache.flink.runtime.io.disk.iomanager.ReadRequest> requestQueue, RequestDoneCallback<Buffer> callback)

Uses of Buffer in org.apache.flink.runtime.io.network.api.serialization

Methods in org.apache.flink.runtime.io.network.api.serialization that return Buffer

Modifier and Type	Method	Description
static Buffer	EventSerializer.toBuffer(AbstractEvent event, boolean hasPriority)

Methods in org.apache.flink.runtime.io.network.api.serialization that return types with arguments of type Buffer

Modifier and Type	Method	Description
org.apache.flink.util.CloseableIterator<Buffer>	RecordDeserializer.getUnconsumedBuffer()	Gets the unconsumed buffer which needs to be persisted in unaligned checkpoint scenario.
org.apache.flink.util.CloseableIterator<Buffer>	SpillingAdaptiveSpanningRecordDeserializer.getUnconsumedBuffer()

Methods in org.apache.flink.runtime.io.network.api.serialization with parameters of type Buffer

Modifier and Type	Method	Description
static AbstractEvent	EventSerializer.fromBuffer(Buffer buffer, ClassLoader classLoader)
void	RecordDeserializer.setNextBuffer(Buffer buffer)
void	SpillingAdaptiveSpanningRecordDeserializer.setNextBuffer(Buffer buffer)

Uses of Buffer in org.apache.flink.runtime.io.network.buffer

Classes in org.apache.flink.runtime.io.network.buffer that implement Buffer

Modifier and Type	Class	Description
class	AbstractCompositeBuffer	An implementation of Buffer which contains multiple partial buffers for network data communication.
class	CompositeBuffer	An implementation of Buffer which contains multiple partial buffers for network data communication.
class	FileRegionBuffer	This class represents a chunk of data in a file channel.
class	FullyFilledBuffer	An implementation of Buffer represents a fully filled buffer which contains multiple partial buffers for network data communication.
class	NetworkBuffer	Wrapper for pooled MemorySegment instances.
class	ReadOnlySlicedNetworkBuffer	Minimal best-effort read-only sliced Buffer implementation wrapping a NetworkBuffer's sub-region based on io.netty.buffer.SlicedByteBuf and io.netty.buffer.ReadOnlyByteBuf.

Fields in org.apache.flink.runtime.io.network.buffer with type parameters of type Buffer

Modifier and Type	Field	Description
protected List<Buffer>	AbstractCompositeBuffer.partialBuffers

Methods in org.apache.flink.runtime.io.network.buffer that return Buffer

Modifier and Type	Method	Description
Buffer	BufferConsumer.build()
Buffer	BufferConsumerWithPartialRecordLength.build()
Buffer	BufferCompressor.compressToIntermediateBuffer(Buffer buffer)	Compresses the given Buffer using BlockCompressor.
Buffer	BufferCompressor.compressToOriginalBuffer(Buffer buffer)	The difference between this method and BufferCompressor.compressToIntermediateBuffer(Buffer) is that this method will copy the compressed data back to the input Buffer starting from offset 0.
Buffer	BufferDecompressor.decompressToIntermediateBuffer(Buffer buffer)	Decompresses the given Buffer using BlockDecompressor.
Buffer	BufferDecompressor.decompressToOriginalBuffer(Buffer buffer)	The difference between this method and BufferDecompressor.decompressToIntermediateBuffer(Buffer) is that this method copies the decompressed data to the input Buffer starting from offset 0.
Buffer	CompositeBuffer.getFullBufferData(org.apache.flink.core.memory.MemorySegment segment)	Returns the full buffer data in one piece of MemorySegment.
Buffer	FileRegionBuffer.readInto(org.apache.flink.core.memory.MemorySegment segment)
Buffer	AbstractCompositeBuffer.readOnlySlice()
Buffer	AbstractCompositeBuffer.readOnlySlice(int index, int length)
Buffer	Buffer.readOnlySlice()	Returns a read-only slice of this buffer's readable bytes, i.e. between getReaderIndex() and getSize().
Buffer	Buffer.readOnlySlice(int index, int length)	Returns a read-only slice of this buffer.
Buffer	BufferProvider.requestBuffer()	Returns a Buffer instance from the buffer provider, if one is available.
Buffer	LocalBufferPool.requestBuffer()
Buffer	AbstractCompositeBuffer.retainBuffer()
Buffer	Buffer.retainBuffer()	Retains this buffer for further use, increasing the reference counter by 1.

Methods in org.apache.flink.runtime.io.network.buffer that return types with arguments of type Buffer

Modifier and Type	Method	Description
List<Buffer>	AbstractCompositeBuffer.getPartialBuffers()

Methods in org.apache.flink.runtime.io.network.buffer with parameters of type Buffer

Modifier and Type	Method	Description
abstract void	AbstractCompositeBuffer.addPartialBuffer(Buffer buffer)
void	CompositeBuffer.addPartialBuffer(Buffer buffer)
void	FullyFilledBuffer.addPartialBuffer(Buffer buffer)
Buffer	BufferCompressor.compressToIntermediateBuffer(Buffer buffer)	Compresses the given Buffer using BlockCompressor.
Buffer	BufferCompressor.compressToOriginalBuffer(Buffer buffer)	The difference between this method and BufferCompressor.compressToIntermediateBuffer(Buffer) is that this method will copy the compressed data back to the input Buffer starting from offset 0.
Buffer	BufferDecompressor.decompressToIntermediateBuffer(Buffer buffer)	Decompresses the given Buffer using BlockDecompressor.
Buffer	BufferDecompressor.decompressToOriginalBuffer(Buffer buffer)	The difference between this method and BufferDecompressor.decompressToIntermediateBuffer(Buffer) is that this method copies the decompressed data to the input Buffer starting from offset 0.
boolean	BufferListener.notifyBufferAvailable(Buffer buffer)	Notification callback if a buffer is recycled and becomes available in buffer pool.

Constructors in org.apache.flink.runtime.io.network.buffer with parameters of type Buffer

Constructor	Description
BufferConsumer(Buffer buffer, int size)	Constructs BufferConsumer instance with static content of a certain size.
BufferConsumer(Buffer buffer, org.apache.flink.runtime.io.network.buffer.BufferBuilder.PositionMarker currentWriterPosition, int currentReaderPosition)

Uses of Buffer in org.apache.flink.runtime.io.network.logger

Methods in org.apache.flink.runtime.io.network.logger with parameters of type Buffer

Modifier and Type	Method	Description
static void	NetworkActionsLogger.traceInput(String action, Buffer buffer, String taskName, InputChannelInfo channelInfo, ChannelStatePersister channelStatePersister, int sequenceNumber)
static void	NetworkActionsLogger.traceOutput(String action, Buffer buffer, String taskName, ResultSubpartitionInfo channelInfo)
static void	NetworkActionsLogger.tracePersist(String action, Buffer buffer, Object channelInfo, long checkpointId)
static void	NetworkActionsLogger.traceRecover(String action, Buffer buffer, String taskName, InputChannelInfo channelInfo)

Uses of Buffer in org.apache.flink.runtime.io.network.partition

Methods in org.apache.flink.runtime.io.network.partition that return Buffer

Modifier and Type	Method	Description
Buffer	ResultSubpartition.BufferAndBacklog.buffer()
Buffer	BufferWithSubpartition.getBuffer()
static Buffer	BufferReaderWriterUtil.readFromByteChannel(FileChannel channel, ByteBuffer headerBuffer, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler bufferRecycler)

Methods in org.apache.flink.runtime.io.network.partition with parameters of type Buffer

Modifier and Type	Method	Description
protected boolean	ResultPartition.canBeCompressed(Buffer buffer)	Whether the buffer can be compressed or not.
static ResultSubpartition.BufferAndBacklog	ResultSubpartition.BufferAndBacklog.fromBufferAndLookahead(Buffer current, Buffer.DataType nextDataType, int backlog, int sequenceNumber)
static void	BufferReaderWriterUtil.setByteChannelBufferHeader(Buffer buffer, ByteBuffer header)

Constructors in org.apache.flink.runtime.io.network.partition with parameters of type Buffer

Constructor	Description
BufferAndBacklog(Buffer buffer, int buffersInBacklog, Buffer.DataType nextDataType, int sequenceNumber)
BufferWithSubpartition(Buffer buffer, int subpartitionIndex)

Uses of Buffer in org.apache.flink.runtime.io.network.partition.consumer

Methods in org.apache.flink.runtime.io.network.partition.consumer that return Buffer

Modifier and Type	Method	Description
Buffer	InputChannel.BufferAndAvailability.buffer()
Buffer	BufferOrEvent.getBuffer()
Buffer	RemoteInputChannel.getNextReceivedBuffer()
Buffer	RemoteInputChannel.requestBuffer()	Requests buffer from input channel directly for receiving network data.
Buffer	RecoveredInputChannel.requestBufferBlocking()

Methods in org.apache.flink.runtime.io.network.partition.consumer with parameters of type Buffer

Modifier and Type	Method	Description
protected OptionalLong	ChannelStatePersister.checkForBarrier(Buffer buffer)
protected void	ChannelStatePersister.maybePersist(Buffer buffer)
boolean	BufferManager.notifyBufferAvailable(Buffer buffer)	The buffer pool notifies this listener of an available floating buffer.
void	RemoteInputChannel.onBuffer(Buffer buffer, int sequenceNumber, int backlog, int subpartitionId)	Handles the input buffer.
void	RecoveredInputChannel.onRecoveredStateBuffer(Buffer buffer)
protected AbstractEvent	ChannelStatePersister.parseEvent(Buffer buffer)	Parses the buffer as an event and returns the CheckpointBarrier if the event is indeed a barrier or returns null in all other cases.

Method parameters in org.apache.flink.runtime.io.network.partition.consumer with type arguments of type Buffer

Modifier and Type	Method	Description
protected void	ChannelStatePersister.startPersisting(long barrierId, List<Buffer> knownBuffers)

Constructors in org.apache.flink.runtime.io.network.partition.consumer with parameters of type Buffer

Constructor	Description
BufferAndAvailability(Buffer buffer, Buffer.DataType nextDataType, int buffersInBacklog, int sequenceNumber)
BufferOrEvent(Buffer buffer, InputChannelInfo channelInfo)
BufferOrEvent(Buffer buffer, InputChannelInfo channelInfo, boolean moreAvailable, boolean morePriorityEvents)

Uses of Buffer in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common that return Buffer

Modifier and Type	Method	Description
static Buffer	TieredStorageUtils.compressBufferIfPossible(Buffer buffer, BufferCompressor bufferCompressor)	Try compress buffer if possible.

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with parameters of type Buffer

Modifier and Type	Method	Description
static boolean	TieredStorageUtils.canBeCompressed(Buffer buffer, BufferCompressor bufferCompressor)	Whether the buffer can be compressed or not.
static Buffer	TieredStorageUtils.compressBufferIfPossible(Buffer buffer, BufferCompressor bufferCompressor)	Try compress buffer if possible.

Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with type arguments of type Buffer

Modifier and Type	Method	Description
static ByteBuffer[]	TieredStorageUtils.generateBufferWithHeaders(List<org.apache.flink.api.java.tuple.Tuple2<Buffer,Integer>> bufferWithIndexes)

Uses of Buffer in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file that return types with arguments of type Buffer

Modifier and Type	Method	Description
List<org.apache.flink.api.java.tuple.Tuple2<Buffer,Integer>>	PartitionFileWriter.SegmentBufferContext.getBufferAndIndexes()
List<Buffer>	PartitionFileReader.ReadBufferResult.getReadBuffers()

Constructor parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file with type arguments of type Buffer

Constructor	Description
ReadBufferResult(List<Buffer> readBuffers, boolean continuousReadSuggested, PartitionFileReader.ReadProgress readProgress)
SegmentBufferContext(int segmentId, List<org.apache.flink.api.java.tuple.Tuple2<Buffer,Integer>> bufferAndIndexes, boolean segmentFinished)

Uses of Buffer in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty that return types with arguments of type Buffer

Modifier and Type	Method	Description
Optional<Buffer>	NettyPayload.getBuffer()
Optional<Buffer>	NettyConnectionReader.readBuffer(int subpartitionId, int segmentId)	Read a buffer from netty connection.
Optional<Buffer>	NettyConnectionReaderImpl.readBuffer(int subpartitionId, int segmentId)

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty with parameters of type Buffer

Modifier and Type	Method	Description
static NettyPayload	NettyPayload.newBuffer(Buffer buffer, int bufferIndex, int subpartitionId)

Uses of Buffer in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage that return types with arguments of type Buffer

Modifier and Type	Method	Description
Optional<Buffer>	TieredStorageConsumerClient.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId)

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type Buffer

Modifier and Type	Method	Description
void	HashBufferAccumulator.flushAccumulatedBuffers(TieredStorageSubpartitionId subpartitionId, Buffer accumulatedBuffer, int numRemainingConsecutiveBuffers)
void	HashSubpartitionBufferAccumulatorContext.flushAccumulatedBuffers(TieredStorageSubpartitionId subpartitionId, Buffer accumulatedBuffer, int numRemainingConsecutiveBuffers)	Flush the accumulated Buffers of the subpartition.
void	TieredStorageMemoryManager.transferBufferOwnership(Object oldOwner, Object newOwner, Buffer buffer)	Notify the memory manager that transferring one buffer's ownership from the old owner to the new owner.
void	TieredStorageMemoryManagerImpl.transferBufferOwnership(Object oldOwner, Object newOwner, Buffer buffer)

Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with type arguments of type Buffer

Modifier and Type	Method	Description
void	BufferAccumulator.setup(org.apache.flink.util.function.TriConsumer<TieredStorageSubpartitionId,Buffer,Integer> bufferFlusher)	Setup the accumulator.
void	HashBufferAccumulator.setup(org.apache.flink.util.function.TriConsumer<TieredStorageSubpartitionId,Buffer,Integer> accumulatedBufferFlusher)
void	SortBufferAccumulator.setup(org.apache.flink.util.function.TriConsumer<TieredStorageSubpartitionId,Buffer,Integer> bufferFlusher)

Uses of Buffer in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier that return types with arguments of type Buffer

Modifier and Type	Method	Description
Optional<Buffer>	TierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)	Get buffer from the consumer agent.

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with parameters of type Buffer

Modifier and Type	Method	Description
boolean	TierProducerAgent.tryWrite(TieredStorageSubpartitionId subpartitionId, Buffer finishedBuffer, Object bufferOwner, int numRemainingConsecutiveBuffers)	Writes the finished Buffer to the consumer.

Uses of Buffer in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk that return types with arguments of type Buffer

Modifier and Type	Method	Description
Optional<Buffer>	DiskTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type Buffer

Modifier and Type	Method	Description
boolean	DiskTierProducerAgent.tryWrite(TieredStorageSubpartitionId subpartitionId, Buffer finishedBuffer, Object bufferOwner, int numRemainingConsecutiveBuffers)

Uses of Buffer in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory that return types with arguments of type Buffer

Modifier and Type	Method	Description
Optional<Buffer>	MemoryTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type Buffer

Modifier and Type	Method	Description
boolean	MemoryTierProducerAgent.tryWrite(TieredStorageSubpartitionId subpartitionId, Buffer finishedBuffer, Object bufferOwner, int numRemainingConsecutiveBuffers)

Uses of Buffer in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote that return types with arguments of type Buffer

Modifier and Type	Method	Description
Optional<Buffer>	RemoteTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId)

Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type Buffer

Modifier and Type	Method	Description
boolean	RemoteTierProducerAgent.tryWrite(TieredStorageSubpartitionId subpartitionId, Buffer buffer, Object bufferOwner, int numRemainingConsecutiveBuffers)