org.apache.flink.connector.testframe.container

Class FlinkContainerTestEnvironment

java.lang.Object

org.apache.flink.connector.testframe.container.FlinkContainerTestEnvironment

All Implemented Interfaces:

ClusterControllable, TestEnvironment, TestResource

public class FlinkContainerTestEnvironment
extends Object
implements TestEnvironment, ClusterControllable

Test environment running job on FlinkContainers.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.connector.testframe.environment.TestEnvironment

TestEnvironment.Endpoint

Constructor Summary

Constructors

Constructor and Description
FlinkContainerTestEnvironment(org.apache.flink.configuration.Configuration clusterConfiguration, int numTaskManagers, int numSlotsPerTaskManager, Collection<String> jarPaths)
FlinkContainerTestEnvironment(org.apache.flink.configuration.Configuration clusterConfiguration, int numTaskManagers, int numSlotsPerTaskManager, String... jarPaths)
FlinkContainerTestEnvironment(FlinkContainersSettings settings)
FlinkContainerTestEnvironment(int numTaskManagers, int numSlotsPerTaskManager, String... jarPaths)

Method Summary

Modifier and Type	Method and Description
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment	createExecutionEnvironment(TestEnvironmentSettings envOptions) Get an instance of StreamExecutionEnvironment for building and executing Flink jobs based on the provided configuration.
static FlinkContainerTestEnvironment	fromSettings(FlinkContainersSettings settings)
String	getCheckpointUri() Get a path in string for storing checkpoint and savepoint in the test environment.
FlinkContainers	getFlinkContainers() Get instance of Flink containers for cluster controlling.
TestEnvironment.Endpoint	getRestEndpoint() Get endpoint of the test environment for connecting via REST API.
void	isolateNetwork(org.apache.flink.core.execution.JobClient jobClient, Runnable afterFailAction) Disconnect network between Flink cluster and external system.
void	startUp() Start up the test resource.
void	tearDown() Tear down the test resource.
String	toString()
void	triggerJobManagerFailover(org.apache.flink.core.execution.JobClient jobClient, Runnable afterFailAction) Triggers a JobManager failover.
void	triggerTaskManagerFailover(org.apache.flink.core.execution.JobClient jobClient, Runnable afterFailAction) Triggers TaskManager failover.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

FlinkContainerTestEnvironment

public FlinkContainerTestEnvironment(int numTaskManagers,
                                     int numSlotsPerTaskManager,
                                     String... jarPaths)

FlinkContainerTestEnvironment

public FlinkContainerTestEnvironment(org.apache.flink.configuration.Configuration clusterConfiguration,
                                     int numTaskManagers,
                                     int numSlotsPerTaskManager,
                                     String... jarPaths)

FlinkContainerTestEnvironment

public FlinkContainerTestEnvironment(org.apache.flink.configuration.Configuration clusterConfiguration,
                                     int numTaskManagers,
                                     int numSlotsPerTaskManager,
                                     Collection<String> jarPaths)

FlinkContainerTestEnvironment

public FlinkContainerTestEnvironment(FlinkContainersSettings settings)

Method Detail

fromSettings

public static FlinkContainerTestEnvironment fromSettings(FlinkContainersSettings settings)

startUp

public void startUp()
             throws Exception

Description copied from interface: TestResource

Start up the test resource.

The implementation of this method should be idempotent.

Specified by:

startUp in interface TestResource

Throws:

Exception - if anything wrong when starting the resource

tearDown

public void tearDown()

Description copied from interface: TestResource

Tear down the test resource.

The test resource should be able to tear down even without a startup (could be a no-op).

Specified by:

tearDown in interface TestResource

createExecutionEnvironment

public org.apache.flink.streaming.api.environment.StreamExecutionEnvironment createExecutionEnvironment(TestEnvironmentSettings envOptions)

Description copied from interface: TestEnvironment

Get an instance of StreamExecutionEnvironment for building and executing Flink jobs based on the provided configuration.

Note that this environment should be bound with the Flink cluster, because this will be the entrypoint to submit Flink jobs (via StreamExecutionEnvironment.execute()) in test cases.

Specified by:

createExecutionEnvironment in interface TestEnvironment

Parameters:

envOptions - options for the environment to satisfy

getRestEndpoint

public TestEnvironment.Endpoint getRestEndpoint()

Description copied from interface: TestEnvironment

Get endpoint of the test environment for connecting via REST API.

Specified by:

getRestEndpoint in interface TestEnvironment

getCheckpointUri

public String getCheckpointUri()

Description copied from interface: TestEnvironment

Get a path in string for storing checkpoint and savepoint in the test environment.

Note that testing framework may have no access to this storage (e.g. Flink cluster is on some cloud service and testing framework is executed locally). In test cases for testing failover scenario, this path will be passed to cluster client directly for triggering checkpoint / savepoint in this path and recovering from checkpoint / savepoint stored under this path.

Specified by:

getCheckpointUri in interface TestEnvironment

triggerJobManagerFailover

public void triggerJobManagerFailover(org.apache.flink.core.execution.JobClient jobClient,
                                      Runnable afterFailAction)
                               throws Exception

Description copied from interface: ClusterControllable

Triggers a JobManager failover.

Specified by:

triggerJobManagerFailover in interface ClusterControllable

Parameters:

jobClient - client of the running job

afterFailAction - action to take before restarting the JobManager

Throws:

Exception

triggerTaskManagerFailover

public void triggerTaskManagerFailover(org.apache.flink.core.execution.JobClient jobClient,
                                       Runnable afterFailAction)
                                throws Exception

Description copied from interface: ClusterControllable

Triggers TaskManager failover.

Specified by:

triggerTaskManagerFailover in interface ClusterControllable

Parameters:

jobClient - client of the running job

afterFailAction - action to take before restarting TaskManager(s)

Throws:

Exception

isolateNetwork

public void isolateNetwork(org.apache.flink.core.execution.JobClient jobClient,
                           Runnable afterFailAction)

Description copied from interface: ClusterControllable

Disconnect network between Flink cluster and external system.

Specified by:

isolateNetwork in interface ClusterControllable

Parameters:

jobClient - client of the running job

afterFailAction - action to take before recovering the network connection

toString

public String toString()

Overrides:

toString in class Object

getFlinkContainers

public FlinkContainers getFlinkContainers()

Get instance of Flink containers for cluster controlling.

Returns:

Flink cluster on Testcontainers