All Classes and Interfaces
Class
Description
Specifies the algorithm used to determine the number of worker
processes to run at any given point in time, based on the amount of
data left to process, the number of workers, and how quickly
existing workers are processing data.
A structured message reporting an autoscaling decision made by the Dataflow
service.
Indicates the type of autoscaling event.
A structured message reporting an autoscaling decision made by the Dataflow
service.
Settings for WorkerPool autoscaling.
Settings for WorkerPool autoscaling.
Metadata for a BigQuery connector used by the job.
Metadata for a BigQuery connector used by the job.
Metadata for a Cloud Bigtable connector used by the job.
Metadata for a Cloud Bigtable connector used by the job.
Request to check is active jobs exists for a project
Request to check is active jobs exists for a project
Response for CheckActiveJobsRequest.
Response for CheckActiveJobsRequest.
All configuration data for a particular Computation.
All configuration data for a particular Computation.
Container Spec.
Container Spec.
A request to create a Cloud Dataflow job from a template.
A request to create a Cloud Dataflow job from a template.
Request to create a Cloud Dataflow job.
Request to create a Cloud Dataflow job.
Identifies the location of a custom souce.
Identifies the location of a custom souce.
Data disk assignment for a given VM instance.
Data disk assignment for a given VM instance.
Configuration options for sampling elements.
Configuration options for sampling elements.
The following enum defines what to sample for a running job.
Metadata for a Datastore connector used by the job.
Metadata for a Datastore connector used by the job.
Describes any options that have an effect on the debugging of pipelines.
Describes any options that have an effect on the debugging of pipelines.
The default set of packages to be staged on a pool of workers.
Request to delete a snapshot.
Request to delete a snapshot.
Response from deleting a snapshot.
Response from deleting a snapshot.
Describes the data disk used by a workflow job.
Describes the data disk used by a workflow job.
Data provided with a pipeline or transform to provide descriptive info.
Data provided with a pipeline or transform to provide descriptive info.
Parameters to pass when launching a dynamic template.
Parameters to pass when launching a dynamic template.
Describes the environment in which a Dataflow Job runs.
Describes the environment in which a Dataflow Job runs.
A message describing the state of a particular execution stage.
A message describing the state of a particular execution stage.
Description of the composing transforms, names/ids, and input/outputs of a
stage of execution.
Description of the composing transforms, names/ids, and input/outputs of a
stage of execution.
Description of an interstitial value between transforms in an execution
stage.
Description of an interstitial value between transforms in an execution
stage.
Description of a transform executed as part of an execution stage.
Description of a transform executed as part of an execution stage.
Description of an input or output of an execution stage.
Description of an input or output of an execution stage.
The state of some component of job execution.
Indicates which [regional endpoint]
(https://cloud.google.com/dataflow/docs/concepts/regional-endpoints) failed
to respond to a request for data.
Indicates which [regional endpoint]
(https://cloud.google.com/dataflow/docs/concepts/regional-endpoints) failed
to respond to a request for data.
Metadata for a File connector used by the job.
Metadata for a File connector used by the job.
Specifies the resource to optimize for in Flexible Resource Scheduling.
The environment values to be set at runtime for flex template.
The environment values to be set at runtime for flex template.
Request to get job execution details.
Request to get job execution details.
Request to get job metrics.
Request to get job metrics.
Request to get the state of a Cloud Dataflow job.
Request to get the state of a Cloud Dataflow job.
Request to get information about a snapshot
Request to get information about a snapshot
Request to get information about a particular execution stage of a job.
Request to get information about a particular execution stage of a job.
A request to retrieve a Cloud Dataflow job template.
A request to retrieve a Cloud Dataflow job template.
The various views of a template that may be retrieved.
The response to a GetTemplate request.
The response to a GetTemplate request.
Template Type.
Information useful for debugging a hot key detection.
Information useful for debugging a hot key detection.
Information about a hot key.
Information about a hot key.
Used in the error_details field of a google.rpc.Status message, this
indicates problems with the template parameter.
Used in the error_details field of a google.rpc.Status message, this
indicates problems with the template parameter.
A specific template-parameter violation.
A specific template-parameter violation.
Defines a job to be run by the Cloud Dataflow service.
Defines a job to be run by the Cloud Dataflow service.
Information about the execution of a job.
Information about the execution of a job.
Additional information about how a Cloud Dataflow job will be executed that
isn't contained in the submitted job.
Additional information about how a Cloud Dataflow job will be executed that
isn't contained in the submitted job.
Contains information about how a particular
[google.dataflow.v1beta3.Step][google.dataflow.v1beta3.Step] will be
executed.
Contains information about how a particular
[google.dataflow.v1beta3.Step][google.dataflow.v1beta3.Step] will be
executed.
A particular message pertaining to a Dataflow job.
A particular message pertaining to a Dataflow job.
Indicates the importance of the message.
Metadata available primarily for filtering jobs.
Metadata available primarily for filtering jobs.
JobMetrics contains a collection of metrics describing the detailed progress
of a Dataflow job.
JobMetrics contains a collection of metrics describing the detailed progress
of a Dataflow job.
Describes the overall state of a
[google.dataflow.v1beta3.Job][google.dataflow.v1beta3.Job].
Specifies the processing model used by a
[google.dataflow.v1beta3.Job], which determines the way the Job is
managed by the Cloud Dataflow service (how workers are scheduled, how
inputs are sharded, etc).
Selector for how much information is returned in Job responses.
Data disk assignment information for a specific key-range of a sharded
computation.
Data disk assignment information for a specific key-range of a sharded
computation.
Location information for a specific key-range of a sharded computation.
Location information for a specific key-range of a sharded computation.
Type of transform or stage operation.
Launch FlexTemplate Parameter.
Launch FlexTemplate Parameter.
A request to launch a Cloud Dataflow job from a FlexTemplate.
A request to launch a Cloud Dataflow job from a FlexTemplate.
Response to the request to launch a job from Flex Template.
Response to the request to launch a job from Flex Template.
Parameters to provide to the template being launched.
Parameters to provide to the template being launched.
A request to launch a template.
A request to launch a template.
Response to the request to launch a template.
Response to the request to launch a template.
Request to list job messages.
Request to list job messages.
Response to a request to list job messages.
Response to a request to list job messages.
Request to list Cloud Dataflow jobs.
Request to list Cloud Dataflow jobs.
This field filters out and returns jobs in the specified job state.
Response to a request to list Cloud Dataflow jobs in a project.
Response to a request to list Cloud Dataflow jobs in a project.
Request to list snapshots.
Request to list snapshots.
List of snapshots.
List of snapshots.
Identifies a metric, by describing the source which generated the
metric.
Identifies a metric, by describing the source which generated the
metric.
Describes the state of a metric.
Describes the state of a metric.
Describes mounted data disk.
Describes mounted data disk.
The packages that must be installed in order for a worker to run the
steps of the Cloud Dataflow job that will be assigned to its worker
pool.
The packages that must be installed in order for a worker to run the
steps of the Cloud Dataflow job that will be assigned to its worker
pool.
Metadata for a specific parameter.
Metadata for a specific parameter.
ParameterMetadataEnumOption specifies the option shown in the enum form.
ParameterMetadataEnumOption specifies the option shown in the enum form.
ParameterType specifies what kind of input we need for this parameter.
A descriptive representation of submitted pipeline as well as the executed
form.
A descriptive representation of submitted pipeline as well as the executed
form.
Information about the progress of some component of job execution.
Information about the progress of some component of job execution.
A point in the timeseries.
A point in the timeseries.
Metadata for a Pub/Sub connector used by the job.
Metadata for a Pub/Sub connector used by the job.
Identifies a pubsub location to use for transferring data into or
out of a streaming Dataflow job.
Identifies a pubsub location to use for transferring data into or
out of a streaming Dataflow job.
Represents a Pubsub snapshot.
Represents a Pubsub snapshot.
The environment values to set at runtime.
The environment values to set at runtime.
RuntimeMetadata describing a runtime environment.
RuntimeMetadata describing a runtime environment.
Additional job parameters that can only be updated during runtime using the
projects.jobs.update method.
Additional job parameters that can only be updated during runtime using the
projects.jobs.update method.
A bug found in the Dataflow SDK.
A bug found in the Dataflow SDK.
Indicates the severity of the bug.
Nature of the issue, ordered from least severe to most.
Defines an SDK harness container for executing Dataflow pipelines.
Defines an SDK harness container for executing Dataflow pipelines.
SDK Information.
SDK Information.
SDK Language.
The version of the SDK used to run the job.
The version of the SDK used to run the job.
The support status of the SDK used to run the job.
Resources used by the Dataflow Service to run the job.
Resources used by the Dataflow Service to run the job.
Specifies the shuffle mode used by a
[google.dataflow.v1beta3.Job], which determines the approach data is shuffled
during processing.
Represents a snapshot of a job.
Represents a snapshot of a job.
Request to create a snapshot of a job.
Request to create a snapshot of a job.
Snapshot state.
Metadata for a Spanner connector used by the job.
Metadata for a Spanner connector used by the job.
Information about the workers and work items within a stage.
Information about the workers and work items within a stage.
Information about a particular execution stage of a job.
Information about a particular execution stage of a job.
State family configuration.
State family configuration.
Defines a particular step within a Cloud Dataflow job.
Defines a particular step within a Cloud Dataflow job.
Information for a straggler.
Information for a straggler.
Information useful for straggler identification and debugging.
Information useful for straggler identification and debugging.
Information useful for debugging a straggler.
Information useful for debugging a straggler.
Summarized straggler identification details.
Summarized straggler identification details.
Streaming appliance snapshot configuration.
Streaming appliance snapshot configuration.
Describes full or partial data disk assignment information of the computation
ranges.
Describes full or partial data disk assignment information of the computation
ranges.
Specifies the Streaming Engine message processing guarantees.
Identifies the location of a streaming side input.
Identifies the location of a streaming side input.
Identifies the location of a streaming computation stage, for
stage-to-stage communication.
Identifies the location of a streaming computation stage, for
stage-to-stage communication.
Information useful for streaming straggler identification and debugging.
Information useful for streaming straggler identification and debugging.
Describes a stream of data, either as input to be processed or as
output of a streaming Dataflow job.
Describes a stream of data, either as input to be processed or as
output of a streaming Dataflow job.
A rich message format, including a human readable string, a key for
identifying the message, and structured data associated with the message for
programmatic consumption.
A rich message format, including a human readable string, a key for
identifying the message, and structured data associated with the message for
programmatic consumption.
Structured data associated with this message.
Structured data associated with this message.
Taskrunner configuration settings.
Taskrunner configuration settings.
Specifies what happens to a resource when a Cloud Dataflow
[google.dataflow.v1beta3.Job][google.dataflow.v1beta3.Job] has completed.
Metadata describing a template.
Metadata describing a template.
Global topology of the streaming Dataflow job, including all
computations and their sharded locations.
Global topology of the streaming Dataflow job, including all
computations and their sharded locations.
Description of the type, names/ids, and input/outputs for a transform.
Description of the type, names/ids, and input/outputs for a transform.
Request to update a Cloud Dataflow job.
Request to update a Cloud Dataflow job.
Information about a worker
Information about a worker
Specifies how to allocate IP addresses to worker machines.
Describes one particular pool of Cloud Dataflow workers to be
instantiated by the Cloud Dataflow service in order to perform the
computations required by a job.
Describes one particular pool of Cloud Dataflow workers to be
instantiated by the Cloud Dataflow service in order to perform the
computations required by a job.
Provides data to pass through to the worker harness.
Provides data to pass through to the worker harness.
Information about an individual work item execution.
Information about an individual work item execution.