Package org.apache.beam.runners.spark

Class SparkJobInvoker

java.lang.Object

org.apache.beam.runners.jobsubmission.JobInvoker

org.apache.beam.runners.spark.SparkJobInvoker

public class SparkJobInvoker
extends org.apache.beam.runners.jobsubmission.JobInvoker

Creates a job invocation to manage the Spark runner's execution of a portable pipeline.

Method Summary

Modifier and Type	Method	Description
static SparkJobInvoker	create(SparkJobServerDriver.SparkServerConfiguration configuration)
protected org.apache.beam.runners.jobsubmission.JobInvocation	invokeWithExecutor(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.Struct options, @Nullable String retrievalToken, org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.util.concurrent.ListeningExecutorService executorService)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

create

public static SparkJobInvoker create(SparkJobServerDriver.SparkServerConfiguration configuration)

invokeWithExecutor

protected org.apache.beam.runners.jobsubmission.JobInvocation invokeWithExecutor(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline,
 org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.Struct options,
 @Nullable String retrievalToken,
 org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.util.concurrent.ListeningExecutorService executorService)

Specified by:

invokeWithExecutor in class org.apache.beam.runners.jobsubmission.JobInvoker