Package org.apache.beam.runners.spark

Class SparkPipelineRunner

java.lang.Object
org.apache.beam.runners.spark.SparkPipelineRunner
All Implemented Interfaces:
org.apache.beam.runners.jobsubmission.PortablePipelineRunner
public class SparkPipelineRunner extends Object implements org.apache.beam.runners.jobsubmission.PortablePipelineRunner
Runs a portable pipeline on Apache Spark.

  • Constructor Summary

    Constructors
    Constructor
    Description
    SparkPipelineRunner(SparkPipelineOptions pipelineOptions)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    static void
    main(String[] args)
    Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.
    org.apache.beam.runners.jobsubmission.PortablePipelineResult
    run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, org.apache.beam.runners.fnexecution.provisioning.JobInfo jobInfo)
     

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

  • Method Details

    • run

      public org.apache.beam.runners.jobsubmission.PortablePipelineResult run(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline, org.apache.beam.runners.fnexecution.provisioning.JobInfo jobInfo)
      Specified by:
      run in interface org.apache.beam.runners.jobsubmission.PortablePipelineRunner

    • main

      public static void main(String[] args) throws Exception
      Main method to be called only as the entry point to an executable jar with structure as defined in PortablePipelineJarUtils.
      Throws:
      Exception