Package com.google.dataflow.v1beta3

Interface RuntimeEnvironmentOrBuilder

All Superinterfaces:
com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder
All Known Implementing Classes:
RuntimeEnvironment, RuntimeEnvironment.Builder
@Generated public interface RuntimeEnvironmentOrBuilder extends com.google.protobuf.MessageOrBuilder

  • Method Details

    • getNumWorkers

      int getNumWorkers()
       Optional. The initial number of Google Compute Engine instances for the
 job. The default value is 11.
      int32 num_workers = 11;
      Returns:
      The numWorkers.

    • getMaxWorkers

      int getMaxWorkers()
       Optional. The maximum number of Google Compute Engine instances to be made
 available to your pipeline during execution, from 1 to 1000. The default
 value is 1.
      int32 max_workers = 1;
      Returns:
      The maxWorkers.

    • getZone

      String getZone()
       Optional. The Compute Engine [availability
 zone](https://cloud.google.com/compute/docs/regions-zones/regions-zones)
 for launching worker instances to run your pipeline.
 In the future, worker_zone will take precedence.
      string zone = 2;
      Returns:
      The zone.

    • getZoneBytes

      com.google.protobuf.ByteString getZoneBytes()
       Optional. The Compute Engine [availability
 zone](https://cloud.google.com/compute/docs/regions-zones/regions-zones)
 for launching worker instances to run your pipeline.
 In the future, worker_zone will take precedence.
      string zone = 2;
      Returns:
      The bytes for zone.

    • getServiceAccountEmail

      String getServiceAccountEmail()
       Optional. The email address of the service account to run the job as.
      string service_account_email = 3;
      Returns:
      The serviceAccountEmail.

    • getServiceAccountEmailBytes

      com.google.protobuf.ByteString getServiceAccountEmailBytes()
       Optional. The email address of the service account to run the job as.
      string service_account_email = 3;
      Returns:
      The bytes for serviceAccountEmail.

    • getTempLocation

      String getTempLocation()
       Required. The Cloud Storage path to use for temporary files.
 Must be a valid Cloud Storage URL, beginning with `gs://`.
      string temp_location = 4;
      Returns:
      The tempLocation.

    • getTempLocationBytes

      com.google.protobuf.ByteString getTempLocationBytes()
       Required. The Cloud Storage path to use for temporary files.
 Must be a valid Cloud Storage URL, beginning with `gs://`.
      string temp_location = 4;
      Returns:
      The bytes for tempLocation.

    • getBypassTempDirValidation

      boolean getBypassTempDirValidation()
       Optional. Whether to bypass the safety checks for the job's temporary
 directory. Use with caution.
      bool bypass_temp_dir_validation = 5;
      Returns:
      The bypassTempDirValidation.

    • getMachineType

      String getMachineType()
       Optional. The machine type to use for the job. Defaults to the value from
 the template if not specified.
      string machine_type = 6;
      Returns:
      The machineType.

    • getMachineTypeBytes

      com.google.protobuf.ByteString getMachineTypeBytes()
       Optional. The machine type to use for the job. Defaults to the value from
 the template if not specified.
      string machine_type = 6;
      Returns:
      The bytes for machineType.

    • getAdditionalExperimentsList

      List<String> getAdditionalExperimentsList()
       Optional. Additional experiment flags for the job, specified with the
 `--experiments` option.
      repeated string additional_experiments = 7;
      Returns:
      A list containing the additionalExperiments.

    • getAdditionalExperimentsCount

      int getAdditionalExperimentsCount()
       Optional. Additional experiment flags for the job, specified with the
 `--experiments` option.
      repeated string additional_experiments = 7;
      Returns:
      The count of additionalExperiments.

    • getAdditionalExperiments

      String getAdditionalExperiments(int index)
       Optional. Additional experiment flags for the job, specified with the
 `--experiments` option.
      repeated string additional_experiments = 7;
      Parameters:
      index - The index of the element to return.
      Returns:
      The additionalExperiments at the given index.

    • getAdditionalExperimentsBytes

      com.google.protobuf.ByteString getAdditionalExperimentsBytes(int index)
       Optional. Additional experiment flags for the job, specified with the
 `--experiments` option.
      repeated string additional_experiments = 7;
      Parameters:
      index - The index of the value to return.
      Returns:
      The bytes of the additionalExperiments at the given index.

    • getNetwork

      String getNetwork()
       Optional. Network to which VMs will be assigned.  If empty or unspecified,
 the service will use the network "default".
      string network = 8;
      Returns:
      The network.

    • getNetworkBytes

      com.google.protobuf.ByteString getNetworkBytes()
       Optional. Network to which VMs will be assigned.  If empty or unspecified,
 the service will use the network "default".
      string network = 8;
      Returns:
      The bytes for network.

    • getSubnetwork

      String getSubnetwork()
       Optional. Subnetwork to which VMs will be assigned, if desired. You can
 specify a subnetwork using either a complete URL or an abbreviated path.
 Expected to be of the form
 "https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK"
 or "regions/REGION/subnetworks/SUBNETWORK". If the subnetwork is located in
 a Shared VPC network, you must use the complete URL.
      string subnetwork = 9;
      Returns:
      The subnetwork.

    • getSubnetworkBytes

      com.google.protobuf.ByteString getSubnetworkBytes()
       Optional. Subnetwork to which VMs will be assigned, if desired. You can
 specify a subnetwork using either a complete URL or an abbreviated path.
 Expected to be of the form
 "https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK"
 or "regions/REGION/subnetworks/SUBNETWORK". If the subnetwork is located in
 a Shared VPC network, you must use the complete URL.
      string subnetwork = 9;
      Returns:
      The bytes for subnetwork.

    • getAdditionalUserLabelsCount

      int getAdditionalUserLabelsCount()
       Optional. Additional user labels to be specified for the job.
 Keys and values should follow the restrictions specified in the [labeling
 restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions)
 page.
 An object containing a list of "key": value pairs.
 Example: { "name": "wrench", "mass": "1kg", "count": "3" }.
      map<string, string> additional_user_labels = 10;

    • containsAdditionalUserLabels

      boolean containsAdditionalUserLabels(String key)
       Optional. Additional user labels to be specified for the job.
 Keys and values should follow the restrictions specified in the [labeling
 restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions)
 page.
 An object containing a list of "key": value pairs.
 Example: { "name": "wrench", "mass": "1kg", "count": "3" }.
      map<string, string> additional_user_labels = 10;

    • getAdditionalUserLabels

      @Deprecated Map<String,String> getAdditionalUserLabels()
      Deprecated.
      Use getAdditionalUserLabelsMap() instead.

    • getAdditionalUserLabelsMap

      Map<String,String> getAdditionalUserLabelsMap()
       Optional. Additional user labels to be specified for the job.
 Keys and values should follow the restrictions specified in the [labeling
 restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions)
 page.
 An object containing a list of "key": value pairs.
 Example: { "name": "wrench", "mass": "1kg", "count": "3" }.
      map<string, string> additional_user_labels = 10;

    • getAdditionalUserLabelsOrDefault

      String getAdditionalUserLabelsOrDefault(String key, String defaultValue)
       Optional. Additional user labels to be specified for the job.
 Keys and values should follow the restrictions specified in the [labeling
 restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions)
 page.
 An object containing a list of "key": value pairs.
 Example: { "name": "wrench", "mass": "1kg", "count": "3" }.
      map<string, string> additional_user_labels = 10;

    • getAdditionalUserLabelsOrThrow

      String getAdditionalUserLabelsOrThrow(String key)
       Optional. Additional user labels to be specified for the job.
 Keys and values should follow the restrictions specified in the [labeling
 restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions)
 page.
 An object containing a list of "key": value pairs.
 Example: { "name": "wrench", "mass": "1kg", "count": "3" }.
      map<string, string> additional_user_labels = 10;

    • getKmsKeyName

      String getKmsKeyName()
       Optional. Name for the Cloud KMS key for the job.
 Key format is:
 projects/<project>/locations/<location>/keyRings/<keyring>/cryptoKeys/<key>
      string kms_key_name = 12;
      Returns:
      The kmsKeyName.

    • getKmsKeyNameBytes

      com.google.protobuf.ByteString getKmsKeyNameBytes()
       Optional. Name for the Cloud KMS key for the job.
 Key format is:
 projects/<project>/locations/<location>/keyRings/<keyring>/cryptoKeys/<key>
      string kms_key_name = 12;
      Returns:
      The bytes for kmsKeyName.

    • getIpConfigurationValue

      int getIpConfigurationValue()
       Optional. Configuration for VM IPs.
      .google.dataflow.v1beta3.WorkerIPAddressConfiguration ip_configuration = 14;
      Returns:
      The enum numeric value on the wire for ipConfiguration.

    • getIpConfiguration

      WorkerIPAddressConfiguration getIpConfiguration()
       Optional. Configuration for VM IPs.
      .google.dataflow.v1beta3.WorkerIPAddressConfiguration ip_configuration = 14;
      Returns:
      The ipConfiguration.

    • getWorkerRegion

      String getWorkerRegion()
       Required. The Compute Engine region
 (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in
 which worker processing should occur, e.g. "us-west1". Mutually exclusive
 with worker_zone. If neither worker_region nor worker_zone is specified,
 default to the control plane's region.
      string worker_region = 15;
      Returns:
      The workerRegion.

    • getWorkerRegionBytes

      com.google.protobuf.ByteString getWorkerRegionBytes()
       Required. The Compute Engine region
 (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in
 which worker processing should occur, e.g. "us-west1". Mutually exclusive
 with worker_zone. If neither worker_region nor worker_zone is specified,
 default to the control plane's region.
      string worker_region = 15;
      Returns:
      The bytes for workerRegion.

    • getWorkerZone

      String getWorkerZone()
       Optional. The Compute Engine zone
 (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in
 which worker processing should occur, e.g. "us-west1-a". Mutually exclusive
 with worker_region. If neither worker_region nor worker_zone is specified,
 a zone in the control plane's region is chosen based on available capacity.
 If both `worker_zone` and `zone` are set, `worker_zone` takes precedence.
      string worker_zone = 16;
      Returns:
      The workerZone.

    • getWorkerZoneBytes

      com.google.protobuf.ByteString getWorkerZoneBytes()
       Optional. The Compute Engine zone
 (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in
 which worker processing should occur, e.g. "us-west1-a". Mutually exclusive
 with worker_region. If neither worker_region nor worker_zone is specified,
 a zone in the control plane's region is chosen based on available capacity.
 If both `worker_zone` and `zone` are set, `worker_zone` takes precedence.
      string worker_zone = 16;
      Returns:
      The bytes for workerZone.

    • getEnableStreamingEngine

      boolean getEnableStreamingEngine()
       Optional. Whether to enable Streaming Engine for the job.
      bool enable_streaming_engine = 17;
      Returns:
      The enableStreamingEngine.

    • getDiskSizeGb

      int getDiskSizeGb()
       Optional. The disk size, in gigabytes, to use on each remote Compute Engine
 worker instance.
      int32 disk_size_gb = 18;
      Returns:
      The diskSizeGb.

    • hasStreamingMode

      boolean hasStreamingMode()
       Optional. Specifies the Streaming Engine message processing guarantees.
 Reduces cost and latency but might result in duplicate messages committed
 to storage. Designed to run simple mapping streaming ETL jobs at the lowest
 cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use
 case. For more information, see
 [Set the pipeline streaming
 mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
      optional .google.dataflow.v1beta3.StreamingMode streaming_mode = 19 [(.google.api.field_behavior) = OPTIONAL];
      Returns:
      Whether the streamingMode field is set.

    • getStreamingModeValue

      int getStreamingModeValue()
       Optional. Specifies the Streaming Engine message processing guarantees.
 Reduces cost and latency but might result in duplicate messages committed
 to storage. Designed to run simple mapping streaming ETL jobs at the lowest
 cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use
 case. For more information, see
 [Set the pipeline streaming
 mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
      optional .google.dataflow.v1beta3.StreamingMode streaming_mode = 19 [(.google.api.field_behavior) = OPTIONAL];
      Returns:
      The enum numeric value on the wire for streamingMode.

    • getStreamingMode

      StreamingMode getStreamingMode()
       Optional. Specifies the Streaming Engine message processing guarantees.
 Reduces cost and latency but might result in duplicate messages committed
 to storage. Designed to run simple mapping streaming ETL jobs at the lowest
 cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use
 case. For more information, see
 [Set the pipeline streaming
 mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
      optional .google.dataflow.v1beta3.StreamingMode streaming_mode = 19 [(.google.api.field_behavior) = OPTIONAL];
      Returns:
      The streamingMode.

    • getAdditionalPipelineOptionsList

      List<String> getAdditionalPipelineOptionsList()
       Optional. Additional pipeline option flags for the job.
      repeated string additional_pipeline_options = 20 [(.google.api.field_behavior) = OPTIONAL];
      Returns:
      A list containing the additionalPipelineOptions.

    • getAdditionalPipelineOptionsCount

      int getAdditionalPipelineOptionsCount()
       Optional. Additional pipeline option flags for the job.
      repeated string additional_pipeline_options = 20 [(.google.api.field_behavior) = OPTIONAL];
      Returns:
      The count of additionalPipelineOptions.

    • getAdditionalPipelineOptions

      String getAdditionalPipelineOptions(int index)
       Optional. Additional pipeline option flags for the job.
      repeated string additional_pipeline_options = 20 [(.google.api.field_behavior) = OPTIONAL];
      Parameters:
      index - The index of the element to return.
      Returns:
      The additionalPipelineOptions at the given index.

    • getAdditionalPipelineOptionsBytes

      com.google.protobuf.ByteString getAdditionalPipelineOptionsBytes(int index)
       Optional. Additional pipeline option flags for the job.
      repeated string additional_pipeline_options = 20 [(.google.api.field_behavior) = OPTIONAL];
      Parameters:
      index - The index of the value to return.
      Returns:
      The bytes of the additionalPipelineOptions at the given index.