Deprecated API

Contents

• Fields

Deprecated Fields

Field

Description

org.apache.beam.runners.spark.translation.SparkContextFactory.TEST_REUSE_SPARK_CONTEXT

This will leak your SparkContext, any attempt to create a new SparkContext later will fail. Please use SparkContextFactory.setProvidedSparkContext(JavaSparkContext) / SparkContextFactory.clearProvidedSparkContext() instead to properly control the lifecycle of your context. Alternatively you may also provide a SparkContext using SparkPipelineOptions.setUsesProvidedSparkContext(boolean) together with SparkContextOptions.setProvidedSparkContext(JavaSparkContext) and close that one appropriately. Tests of this module should use SparkContextRule.