You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/dyn/dataproc_v1.projects.locations.autoscalingPolicies.html
+6Lines changed: 6 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -138,6 +138,7 @@ <h3>Method Details</h3>
138
138
"scaleUpMinWorkerFraction": 3.14, # Optional. Minimum scale-up threshold as a fraction of total cluster size before scaling occurs. For example, in a 20-worker cluster, a threshold of 0.1 means the autoscaler must recommend at least a 2-worker scale-up for the cluster to scale. A threshold of 0 means the autoscaler will scale up on any recommended change.Bounds: 0.0, 1.0. Default: 0.0.
139
139
},
140
140
},
141
+
"clusterType": "A String", # Optional. The type of the clusters for which this autoscaling policy is to be configured.
141
142
"id": "A String", # Required. The policy id.The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.
142
143
"labels": { # Optional. The labels to associate with this autoscaling policy. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with an autoscaling policy.
143
144
"a_key": "A String",
@@ -182,6 +183,7 @@ <h3>Method Details</h3>
182
183
"scaleUpMinWorkerFraction": 3.14, # Optional. Minimum scale-up threshold as a fraction of total cluster size before scaling occurs. For example, in a 20-worker cluster, a threshold of 0.1 means the autoscaler must recommend at least a 2-worker scale-up for the cluster to scale. A threshold of 0 means the autoscaler will scale up on any recommended change.Bounds: 0.0, 1.0. Default: 0.0.
183
184
},
184
185
},
186
+
"clusterType": "A String", # Optional. The type of the clusters for which this autoscaling policy is to be configured.
185
187
"id": "A String", # Required. The policy id.The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.
186
188
"labels": { # Optional. The labels to associate with this autoscaling policy. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with an autoscaling policy.
187
189
"a_key": "A String",
@@ -251,6 +253,7 @@ <h3>Method Details</h3>
251
253
"scaleUpMinWorkerFraction": 3.14, # Optional. Minimum scale-up threshold as a fraction of total cluster size before scaling occurs. For example, in a 20-worker cluster, a threshold of 0.1 means the autoscaler must recommend at least a 2-worker scale-up for the cluster to scale. A threshold of 0 means the autoscaler will scale up on any recommended change.Bounds: 0.0, 1.0. Default: 0.0.
252
254
},
253
255
},
256
+
"clusterType": "A String", # Optional. The type of the clusters for which this autoscaling policy is to be configured.
254
257
"id": "A String", # Required. The policy id.The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.
255
258
"labels": { # Optional. The labels to associate with this autoscaling policy. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with an autoscaling policy.
256
259
"a_key": "A String",
@@ -350,6 +353,7 @@ <h3>Method Details</h3>
350
353
"scaleUpMinWorkerFraction": 3.14, # Optional. Minimum scale-up threshold as a fraction of total cluster size before scaling occurs. For example, in a 20-worker cluster, a threshold of 0.1 means the autoscaler must recommend at least a 2-worker scale-up for the cluster to scale. A threshold of 0 means the autoscaler will scale up on any recommended change.Bounds: 0.0, 1.0. Default: 0.0.
351
354
},
352
355
},
356
+
"clusterType": "A String", # Optional. The type of the clusters for which this autoscaling policy is to be configured.
353
357
"id": "A String", # Required. The policy id.The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.
354
358
"labels": { # Optional. The labels to associate with this autoscaling policy. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with an autoscaling policy.
355
359
"a_key": "A String",
@@ -500,6 +504,7 @@ <h3>Method Details</h3>
500
504
"scaleUpMinWorkerFraction": 3.14, # Optional. Minimum scale-up threshold as a fraction of total cluster size before scaling occurs. For example, in a 20-worker cluster, a threshold of 0.1 means the autoscaler must recommend at least a 2-worker scale-up for the cluster to scale. A threshold of 0 means the autoscaler will scale up on any recommended change.Bounds: 0.0, 1.0. Default: 0.0.
501
505
},
502
506
},
507
+
"clusterType": "A String", # Optional. The type of the clusters for which this autoscaling policy is to be configured.
503
508
"id": "A String", # Required. The policy id.The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.
504
509
"labels": { # Optional. The labels to associate with this autoscaling policy. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with an autoscaling policy.
505
510
"a_key": "A String",
@@ -544,6 +549,7 @@ <h3>Method Details</h3>
544
549
"scaleUpMinWorkerFraction": 3.14, # Optional. Minimum scale-up threshold as a fraction of total cluster size before scaling occurs. For example, in a 20-worker cluster, a threshold of 0.1 means the autoscaler must recommend at least a 2-worker scale-up for the cluster to scale. A threshold of 0 means the autoscaler will scale up on any recommended change.Bounds: 0.0, 1.0. Default: 0.0.
545
550
},
546
551
},
552
+
"clusterType": "A String", # Optional. The type of the clusters for which this autoscaling policy is to be configured.
547
553
"id": "A String", # Required. The policy id.The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.
548
554
"labels": { # Optional. The labels to associate with this autoscaling policy. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with an autoscaling policy.
"sparkBatch": { # A configuration for running an Apache Spark (https://spark.apache.org/) batch workload. # Optional. Spark batch config.
253
262
"archiveUris": [ # Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
@@ -453,6 +462,15 @@ <h3>Method Details</h3>
453
462
"a_key": "A String",
454
463
},
455
464
"outputUri": "A String", # Output only. A URI pointing to the location of the stdout and stderr of the workload.
465
+
"propertiesInfo": { # Properties of the workload organized by origin. # Optional. Properties of the workload organized by origin.
466
+
"autotuningProperties": { # Output only. Properties set by autotuning engine.
"sparkBatch": { # A configuration for running an Apache Spark (https://spark.apache.org/) batch workload. # Optional. Spark batch config.
458
476
"archiveUris": [ # Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
@@ -616,6 +634,15 @@ <h3>Method Details</h3>
616
634
"a_key": "A String",
617
635
},
618
636
"outputUri": "A String", # Output only. A URI pointing to the location of the stdout and stderr of the workload.
637
+
"propertiesInfo": { # Properties of the workload organized by origin. # Optional. Properties of the workload organized by origin.
638
+
"autotuningProperties": { # Output only. Properties set by autotuning engine.
"sparkBatch": { # A configuration for running an Apache Spark (https://spark.apache.org/) batch workload. # Optional. Spark batch config.
621
648
"archiveUris": [ # Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
<pclass="firstline">Obtain Spark Plan Graph for a Spark Application SQL execution. Limits the number of clusters returned as part of the graph to 10000.</p>
name: string, Required. The fully qualified name of the batch to retrieve in the format "projects/PROJECT_ID/locations/DATAPROC_REGION/batches/BATCH_ID/sparkApplications/APPLICATION_ID" (required)
334
-
parent: string, Required. Parent (Batch) resource reference.
335
-
x__xgafv: string, V1 error format.
336
-
Allowed values
337
-
1 - v1 error format
338
-
2 - v2 error format
339
-
340
-
Returns:
341
-
An object of the form:
342
-
343
-
{ # Details of Native Build Info for a Spark Application
344
-
"buildInfo": { # Native Build Info Data
345
-
"buildClass": "A String", # Optional. Build class of Native.
346
-
"buildInfo": [ # Optional. Build related details.
<pre>Obtain data corresponding to a particular Native SQL Query for a Spark Application.
359
-
360
-
Args:
361
-
name: string, Required. The fully qualified name of the batch to retrieve in the format "projects/PROJECT_ID/locations/DATAPROC_REGION/batches/BATCH_ID/sparkApplications/APPLICATION_ID" (required)
362
-
executionId: string, Required. Execution ID
363
-
parent: string, Required. Parent (Batch) resource reference.
364
-
x__xgafv: string, V1 error format.
365
-
Allowed values
366
-
1 - v1 error format
367
-
2 - v2 error format
368
-
369
-
Returns:
370
-
An object of the form:
371
-
372
-
{ # Details of a query for a Spark Application
373
-
"executionData": { # Native SQL Execution Data # Native SQL Execution Data
374
-
"description": "A String", # Optional. Description of the execution.
375
-
"executionId": "A String", # Required. Execution ID of the Native SQL Execution.
376
-
"fallbackDescription": "A String", # Optional. Description of the fallback.
377
-
"fallbackNodeToReason": [ # Optional. Fallback node to reason.
<pre>Obtain data corresponding to Native SQL Queries for a Spark Application.
1507
-
1508
-
Args:
1509
-
name: string, Required. The fully qualified name of the batch to retrieve in the format "projects/PROJECT_ID/locations/DATAPROC_REGION/batches/BATCH_ID/sparkApplications/APPLICATION_ID" (required)
1510
-
pageSize: integer, Optional. Maximum number of queries to return in each response. The service may return fewer than this. The default page size is 10; the maximum page size is 100.
1511
-
pageToken: string, Optional. A page token received from a previous SearchSparkApplicationNativeSqlQueries call. Provide this token to retrieve the subsequent page.
1512
-
parent: string, Required. Parent (Batch) resource reference.
1513
-
x__xgafv: string, V1 error format.
1514
-
Allowed values
1515
-
1 - v1 error format
1516
-
2 - v2 error format
1517
-
1518
-
Returns:
1519
-
An object of the form:
1520
-
1521
-
{ # List of all Native SQL queries details for a Spark Application.
1522
-
"nextPageToken": "A String", # This token is included in the response if there are more results to fetch. To fetch additional results, provide this value as the page_token in a subsequent SearchSparkApplicationNativeSqlQueriesRequest.
1523
-
"sparkApplicationNativeSqlQueries": [ # Output only. Native SQL Execution Data
1524
-
{ # Native SQL Execution Data
1525
-
"description": "A String", # Optional. Description of the execution.
1526
-
"executionId": "A String", # Required. Execution ID of the Native SQL Execution.
1527
-
"fallbackDescription": "A String", # Optional. Description of the fallback.
1528
-
"fallbackNodeToReason": [ # Optional. Fallback node to reason.
0 commit comments