org.apache.flink.runtime.highavailability.zookeeper

类 ZooKeeperLeaderElectionHaServices

java.lang.Object

org.apache.flink.runtime.highavailability.AbstractHaServices

org.apache.flink.runtime.highavailability.zookeeper.ZooKeeperLeaderElectionHaServices

所有已实现的接口:

AutoCloseable, GloballyCleanableResource, ClientHighAvailabilityServices, HighAvailabilityServices

public class ZooKeeperLeaderElectionHaServices
extends AbstractHaServices

ZooKeeper HA services that only use a single leader election per process.

 /flink
      +/cluster_id_1/leader/latch
      |            |       /resource_manager/connection_info
      |            |       /dispatcher/connection_info
      |            |       /rest_server/connection_info
      |            |       /job-id-1/connection_info
      |            |       /job-id-2/connection_info
      |            |
      |            |
      |            +jobgraphs/job-id-1
      |            |         /job-id-2
      |            +jobs/job-id-1/checkpoints/latest
      |                 |                    /latest-1
      |                 |                    /latest-2
      |                 |       /checkpoint_id_counter
 

字段概要

从类继承的字段 org.apache.flink.runtime.highavailability.AbstractHaServices

configuration, ioExecutor, logger

从接口继承的字段 org.apache.flink.runtime.highavailability.HighAvailabilityServices

DEFAULT_JOB_ID, DEFAULT_LEADER_ID

构造器概要

构造器

构造器和说明
ZooKeeperLeaderElectionHaServices(CuratorFrameworkWithUnhandledErrorListener curatorFrameworkWrapper, org.apache.flink.configuration.Configuration configuration, Executor executor, BlobStoreService blobStoreService)

方法概要

限定符和类型	方法和说明
CheckpointRecoveryFactory	createCheckpointRecoveryFactory() Create the checkpoint recovery factory for the job manager.
JobGraphStore	createJobGraphStore() Create the submitted job graph store for the job manager.
protected LeaderRetrievalService	createLeaderRetrievalService(String componentId) Create leader retrieval service with specified leaderName.
protected void	deleteZNode(String path)
protected String	getLeaderPathForDispatcher() Get the leader path for Dispatcher.
protected String	getLeaderPathForJobManager(org.apache.flink.api.common.JobID jobID) Get the leader path for specific JobManager.
protected String	getLeaderPathForResourceManager() Get the leader path for ResourceManager.
protected String	getLeaderPathForRestServer() Get the leader path for RestServer.
protected void	internalCleanup() Clean up the meta data in the distributed system(e.g.
protected void	internalCleanupJobData(org.apache.flink.api.common.JobID jobID) Clean up the meta data in the distributed system(e.g.
protected void	internalClose() Closes the components which is used for external operations(e.g.

从类继承的方法 org.apache.flink.runtime.highavailability.AbstractHaServices

cleanupAllData, close, createBlobStore, getCheckpointRecoveryFactory, getClusterRestEndpointLeaderElection, getClusterRestEndpointLeaderRetriever, getDispatcherLeaderElection, getDispatcherLeaderRetriever, getJobGraphStore, getJobManagerLeaderElection, getJobManagerLeaderRetriever, getJobManagerLeaderRetriever, getJobResultStore, getResourceManagerLeaderElection, getResourceManagerLeaderRetriever, globalCleanupAsync

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.highavailability.HighAvailabilityServices

closeWithOptionalClean, getWebMonitorLeaderElection, getWebMonitorLeaderRetriever

构造器详细资料

ZooKeeperLeaderElectionHaServices

public ZooKeeperLeaderElectionHaServices(CuratorFrameworkWithUnhandledErrorListener curatorFrameworkWrapper,
                                         org.apache.flink.configuration.Configuration configuration,
                                         Executor executor,
                                         BlobStoreService blobStoreService)
                                  throws Exception

抛出:

Exception

方法详细资料

createCheckpointRecoveryFactory

public CheckpointRecoveryFactory createCheckpointRecoveryFactory()
                                                          throws Exception

从类复制的说明: AbstractHaServices

Create the checkpoint recovery factory for the job manager.

指定者:

createCheckpointRecoveryFactory 在类中 AbstractHaServices

返回:

Checkpoint recovery factory

抛出:

Exception

createJobGraphStore

public JobGraphStore createJobGraphStore()
                                  throws Exception

从类复制的说明: AbstractHaServices

Create the submitted job graph store for the job manager.

指定者:

createJobGraphStore 在类中 AbstractHaServices

返回:

Submitted job graph store

抛出:

Exception - if the submitted job graph store could not be created

internalClose

protected void internalClose()

从类复制的说明: AbstractHaServices

Closes the components which is used for external operations(e.g. Zookeeper Client, Kubernetes Client).

指定者:

internalClose 在类中 AbstractHaServices

internalCleanup

protected void internalCleanup()
                        throws Exception

从类复制的说明: AbstractHaServices

Clean up the meta data in the distributed system(e.g. Zookeeper, Kubernetes ConfigMap).

If an exception occurs during internal cleanup, we will continue the cleanup in AbstractHaServices.cleanupAllData() and report exceptions only after all cleanup steps have been attempted.

指定者:

internalCleanup 在类中 AbstractHaServices

抛出:

Exception - when do the cleanup operation on external storage.

internalCleanupJobData

protected void internalCleanupJobData(org.apache.flink.api.common.JobID jobID)
                               throws Exception

从类复制的说明: AbstractHaServices

Clean up the meta data in the distributed system(e.g. Zookeeper, Kubernetes ConfigMap) for the specified Job. Method implementations need to be thread-safe.

指定者:

internalCleanupJobData 在类中 AbstractHaServices

参数:

jobID - The identifier of the job to cleanup.

抛出:

Exception - when do the cleanup operation on external storage.

deleteZNode

protected void deleteZNode(String path)
                    throws Exception

抛出:

Exception

createLeaderRetrievalService

protected LeaderRetrievalService createLeaderRetrievalService(String componentId)

从类复制的说明: AbstractHaServices

Create leader retrieval service with specified leaderName.

指定者:

createLeaderRetrievalService 在类中 AbstractHaServices

参数:

componentId - ConfigMap name in Kubernetes or child node path in Zookeeper.

返回:

Return LeaderRetrievalService using Zookeeper or Kubernetes.

getLeaderPathForResourceManager

protected String getLeaderPathForResourceManager()

从类复制的说明: AbstractHaServices

Get the leader path for ResourceManager.

指定者:

getLeaderPathForResourceManager 在类中 AbstractHaServices

返回:

Return the ResourceManager leader name. It is ConfigMap name in Kubernetes or child node path in Zookeeper.

getLeaderPathForDispatcher

protected String getLeaderPathForDispatcher()

从类复制的说明: AbstractHaServices

Get the leader path for Dispatcher.

指定者:

getLeaderPathForDispatcher 在类中 AbstractHaServices

返回:

Return the Dispatcher leader name. It is ConfigMap name in Kubernetes or child node path in Zookeeper.

getLeaderPathForJobManager

protected String getLeaderPathForJobManager(org.apache.flink.api.common.JobID jobID)

从类复制的说明: AbstractHaServices

Get the leader path for specific JobManager.

指定者:

getLeaderPathForJobManager 在类中 AbstractHaServices

参数:

jobID - job id

返回:

Return the JobManager leader name for specified job id. It is ConfigMap name in Kubernetes or child node path in Zookeeper.

getLeaderPathForRestServer

protected String getLeaderPathForRestServer()

从类复制的说明: AbstractHaServices

Get the leader path for RestServer.

指定者:

getLeaderPathForRestServer 在类中 AbstractHaServices

返回:

Return the RestServer leader name. It is ConfigMap name in Kubernetes or child node path in Zookeeper.