org.apache.flink.runtime.state.changelog

Interface StateChangelogWriter<Handle extends ChangelogStateHandle>

All Superinterfaces:

AutoCloseable

@Internal
public interface StateChangelogWriter<Handle extends ChangelogStateHandle>
extends AutoCloseable

Allows to write data to the log. Scoped to a single writer (e.g. state backend).

Method Summary

Modifier and Type	Method and Description
void	append(int keyGroup, byte[] value) Appends the provided data to this log.
void	close() Close this log.
void	confirm(SequenceNumber from, SequenceNumber to) Mark the given state changes as confirmed by the JM.
SequenceNumber	getLowestSequenceNumber()
SequenceNumber	initialSequenceNumber() Get the initial SequenceNumber that is used for the first element.
SequenceNumber	nextSequenceNumber() Get SequenceNumber to be used for the next element added by append.
CompletableFuture<Handle>	persist(SequenceNumber from) Durably persist previously appended data starting from the provided SequenceNumber and up to the latest change added.
void	reset(SequenceNumber from, SequenceNumber to) Reset the state the given state changes.
void	truncate(SequenceNumber to) Truncate in-memory view of this state changelog to free up resources.

Method Detail

initialSequenceNumber

SequenceNumber initialSequenceNumber()

Get the initial SequenceNumber that is used for the first element.

nextSequenceNumber

SequenceNumber nextSequenceNumber()

Get SequenceNumber to be used for the next element added by append.

append

void append(int keyGroup,
            byte[] value)
     throws IOException

Appends the provided data to this log. No persistency guarantees.

Throws:

IOException

persist

CompletableFuture<Handle> persist(SequenceNumber from)
                           throws IOException

Durably persist previously appended data starting from the provided SequenceNumber and up to the latest change added. After this call, one of confirm, reset, or truncate eventually must be called for the corresponding change set. with reset/truncate/confirm methods?

Parameters:

from - inclusive

Throws:

IOException

truncate

void truncate(SequenceNumber to)

Truncate in-memory view of this state changelog to free up resources. Called upon state materialization. Any persisted state changes will not be discarded; any ongoing persist calls will not be affected.

Parameters:

to - exclusive

confirm

void confirm(SequenceNumber from,
             SequenceNumber to)

Mark the given state changes as confirmed by the JM.

Parameters:

from - inclusive

to - exclusive

reset

void reset(SequenceNumber from,
           SequenceNumber to)

Reset the state the given state changes. Called upon abortion so that if requested later then these changes will be re-uploaded.

close

void close()

Close this log. No new appends will be possible. Any appended but not persisted records will be lost.

Specified by:

close in interface AutoCloseable

getLowestSequenceNumber

@VisibleForTesting
SequenceNumber getLowestSequenceNumber()