Yq\SrSSKJr SSKJr SSKJr SSKrSSKrSSKJr SSKJ r SSK J r SS K J r SS K Jr SS KJr SSKrS rS rSrSrSrSrSrSrSrSrSrSrSrSrSr Sr!Sr"Sr#Sr$Sr%S r&S!r'SVS"jr(S#r)S$r*S%r+S&r,S'r-S(r.S)r/S*r0S+r1S,r2S-r3S.r4S/r5S0r6S1r7S2r8SWS3jr9S4r:S5r;S6rSXS9jr?S:r@SWS;jrAS<rBS=rCS>rDSVS?jrES@rFSArGSBrHSCrISDrJSErKSFrLSGrMSHrNSIrOSJrPSKrQSLrRSMrSSNrTSOrUSPrVSQrWSRrXSSrYSTrZSUr[g)Yz.Flags for workflow templates related commands.)absolute_import)division)unicode_literalsN)actions) arg_parsers)concepts)deps)concept_parsers) propertiesc[R"[RRR 5/n[ R"SSUS9$)Nregiona Dataproc region for the {resource}. Each Dataproc region constitutes an independent resource namespace constrained to deploying instances into Compute Engine zones inside the region. Overrides the default `dataproc/region` property value for this command invocation.name help_text fallthroughs)r PropertyFallthroughr VALUESdataprocr r ResourceParameterAttributeConfigrs 0lib/googlecloudsdk/command_lib/dataproc/flags.py_RegionAttributeConfigr"sG**:+<+<+E+E+L+LMN,  2 2  /   !!c[R"[RRR 5/n[ R"SSUS9$)NlocationaDataproc location for the {resource}. Each Dataproc location constitutes an independent resource namespace constrained to deploying instances into Compute Engine zones inside the location. Overrides the default `dataproc/location` property value for this command invocation.r)r rr rrrrrrs r_LocationAttributeConfigr/sG**:+<+<+E+E+N+NOP,  2 2  /   !!rc[RRRnUR SUR [ R"U5S9 g)N--regionhelpaction)r rrr add_argumentrr StoreProperty)parser region_props r AddRegionFlagr&<sF!!**11+   " "; / 1rc[RRRnUR SUR [ R"U5S9 g)Nz --locationr)r rrrr"rrr#)r$ location_props rAddLocationFlagr)EsF##,,55-  " "  " "= 1 3rc [R"SUSS[R[5S9n[R R SU[RRRRSS9RU5 g)z.Add resrouce arg for projects/{}/locations/{}.zdataproc.projects.locationsr T) api_version resource_namedisable_auto_completers projectsId locationsIdrrequiredN) r ResourceSpec DEFAULT_PROJECT_ATTRIBUTE_CONFIGrr ConceptParser ForResourcer rrr r AddToParser)r$r+specs rAddProjectsLocationsResourceArgr8Nsz   #"::(*  ,$++   ''11 ,![(rc(URSSSSS9 g)z'Adds async flag with our own help text.z--async store_trueasync_zMReturn immediately without waiting for the operation in progress to complete.)r!destr Nr"r$s rAddAsyncr?`s#   $ &rc,[R"SSS9$)NclusterzThe Cluster name.rrrrrr ClusterConfigrEjs  2 2 # rc r[R"SUSS[R[5[ 5S9$)N"dataproc.projects.regions.clustersrATr+r,r- projectIdr clusterNamerr2r3rrEr+s r_GetClusterResourceSpecrMqs5   *"99 # %/ rc[RRS[U5SR U5SS9R U5 g)NrAzThe name of the cluster to {}.Tr0)r r4r5rMformatr6r$verbr+s rAddClusterResourceArgrR}sC++k*&--d3 ,![(rc,[R"SSS9$)N gke-clusterzThe GKE Cluster path.rBrCrDrrGkeClusterConfigrUs  2 2 ' rc[R"S5[R"[RR R 5/$)Nr)r ArgFallthroughrr rrr rDrr_DataprocRegionFallthroughrXs: *% z0099@@A rc>[R"SS[5S9$)Nzgke-cluster-locationzGKE region for the {resource}.rrrrXrDrr_GkeLocationAttributeConfigr[s!  2 2 !0-/ 11rcn[R"SS[R[5[ 5S9$)Nz%container.projects.locations.clustersrTr,r.r/ clustersId)rr2r3r[rUrDrr_GetGkeClusterResourceSpecr_s0   -!::-/!#  rcr[RRS[5SSS9R U5 g)Nz --gke-clusterz3The GKE cluster to install the Dataproc cluster on.Tr0)r r4r5r_r6r>s rAddGkeClusterResourceArgras6++ "; ,![(rc,[R"SSS9$)Nmetastore-service?Dataproc Metastore Service to be used as an external metastore.rBrCrDrrMetastoreServiceConfigres  2 2 Q rc>[R"SS[5S9$)Nzmetastore-service-locationz/Dataproc Metastore location for the {resource}.rrZrDrr(_MetastoreServiceLocationAttributeConfigrgs!  2 2 'A-/ 11rcn[R"SS[R[5[ 5S9$)Nz%metastore.projects.locations.servicesrc)r,r.r/ servicesId)rr2r3rgrerDrr _GetMetastoreServiceResourceSpecrjs0   -':::<')  rct[RRS[5S5R U5 g)Nz--metastore-servicerd)r r4r5rjr6r>s rAddMetastoreServiceResourceArgrls.++&(GKrc,[R"SSS9$)Nhistory-server-clusterzSpark History Server. Resource name of an existing Dataproc cluster to act as a Spark History Server for workloads run on the Cluster.rBrCrDrrHistoryServerClusterConfigros  2 2 #? @@rc>[R"SS[5S9$)Nzhistory-server-cluster-regionzsCompute Engine region for the {resource}. It must be the same region as the Dataproc cluster that is being created.rrZrDrr*_HistoryServerClusterRegionAttributeConfigrqs$  2 2 *N-/  11rcn[R"SS[R[5[ 5S9$)NrGrn)r,rIr rJ)rr2r3rqrorDrr$_GetHistoryServerClusterResourceSpecrss0   *,99 7 9,.  rct[RRS[5S5R U5 g)Nz--history-server-clusterzwA Dataproc Cluster created as a History Server, see https://cloud.google.com/dataproc/docs/concepts/jobs/history-server)r r4r5rsr6r>s r"AddHistoryServerClusterResourceArgrus.++ *,Krc URSS9nUR"S/U(aS/O/Q7S[R"[R R R5S.6 URS[R"5/SSS S 9 g ) z!Add zone and excluded zones flag.T)mutexz--zonez-zz The compute zone (e.g. us-central1-a) for the cluster. If empty and --region is set to a value other than `global`, the server will pick a zone in the region. rz--auto-zone-exclude-zonesZONEz A comma-separated list of compute zones (e.g. us-central1-a) to exclude when picking the zone for the cluster. )typedefaultmetavarhiddenr N) add_argument_groupr"rr#r rcomputezonerArgList)r$ short_flagszone_and_excluded_zones_groups rAddZoneAndExcludedZonesFlagsrs"(";";$";"G,, 2    " ":#4#4#<#<#A#A B  ,,!       - rc.URS[SS9 g)Nz --versionz%The version of the workflow template.)ryr r"intr>s rAddVersionFlagrs"IKrcDURSSRX5SS9 g)Nz--filez'The YAML file containing the {0} to {1}Tr r1)r"rO)r$ input_typer!s r AddFileFlagr s) 4 ; ;J Orc$URSSS9 g)NMAIN_PYTHON_FILEzOURI of the main Python file to use as the Spark driver. Must be a ``.py'' file.r r=r>s rAddMainPythonFilers (*rcfURSS9nURSSSS9 URSSS S9 g ) zMain class or main jar.Tr0z--class main_classzClass contains the main method of the job. The jar file that contains the class must be in the classpath or specified in `jar_files`.)r<r z--jarmain_jarzURI of the main jar file.N)add_mutually_exclusive_groupr")r$ main_groups rAddJvmMainMutexrsQ22D2A*   +-  J%@Brc$URSSS9 g)N SQL_SCRIPTz=URI of the script that contains Spark SQL queries to execute.rr=r>s rAddMainSqlScriptr+s JLrcNURS[R"5SSS9 g)zAdd --params flag.z--varsz NAME=VALUEzcMapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).)ryr{r Nr"rArgDictr>s rAddSqlScriptVariablesr1s,     5 7rcPURS[R"5S/SS9 g)zAdd --jars flag.z--jarsJARzCComma-separated list of jar files to be provided to the classpaths.ryr{rzr Nr"rrr>s r AddJarFilesr;s/      rc$URSSS9 g)N MAIN_R_FILEzMURI of the main R file to use as the driver. Must be a ``.R'' or ``.r'' file.rr=r>s r AddMainRFilerFs 35rcPURS[R"5S/SS9 g)zAdd --py-files flag.z --py-filesPYzComma-separated list of Python scripts to be passed to the PySpark framework. Supported file types: ``.py'', ``.egg'' and ``.zip.''rNrr>s rAddPythonFilesrMs/       rcPURS[R"5S/SS9 g)Nz--filesFILEz,Files to be placed in the working directory.rrr>s r AddOtherFilesrYs-     9 ;rcPURS[R"5S/SS9 g)Nz --archivesARCHIVEzoArchives to be extracted into the working directory. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.rrr>s r AddArchivesrbs1     I KrcFURSS[R/SS9 g)zRemaining args to the program.argsJOB_ARGz Arguments to pass to the driver.)r{nargsrzr N)r"argparse REMAINDERr>s rAddArgsrls*     - /rc$URSSS9 g)z5Cloud Storage bucket to upload workload dependencies.z --deps-bucketz7A Cloud Storage bucket to upload workload dependencies.rNr=r>s r AddBucketrvs rc,[R"SSS9$)Njobz The Job ID.rBrCrDrr JobConfigr~s  2 2  rc r[R"SUSS[R[5[ 5S9$)Nzdataproc.projects.regions.jobsrT)r+r,r-rIr jobId)rr2r3rrrLs r_GetJobResourceSpecrs5   &"99 # % K rc[RRS[U5SR U5SS9R U5 g)NrzThe ID of the job to {0}.Tr0)r r4r5rrOr6rPs rAddJobResourceArgrsC++ +&!((. ,![(rc^^SmUU4Sjn[RRSU"U5SRU5SS9R U5 g)z'Adds batch resource argument to parser.c,[R"SSS9$)Nbatchz Batch job ID.rBrCrDrr BatchConfig(AddBatchResourceArg..BatchConfigs  4 4 ! rc >[R"SUSS[RT(a [5O [ 5T"5S9$)Nz#dataproc.projects.locations.batchesrT)r+r,r-r.r/ batchesId)rr2r3rr)r+r use_locations rGetBatchResourceSpec1AddBatchResourceArg..GetBatchResourceSpecsA  - $<< -. # %-  rrzID of the batch job to {0}.Tr0Nr r4r5rOr6)r$rQr+rrrs ` @rAddBatchResourceArgrsP ++ ;'#**40 ,![(rc^SmU4Sjn[RRSU"U5SRU5SS9R U5 g)z)Adds session resource argument to parser.c,[R"SSS9$)Nsessionz Session ID.rBrCrDrr SessionConfig,AddSessionResourceArg..SessionConfigs  4 4  rc n>[R"SUSS[R[5T"5S9$)Nz$dataproc.projects.locations.sessionsrT)r+r,r-r.r/ sessionsId)rr2r3r)r+rs rGetSessionResourceSpec5AddSessionResourceArg..GetSessionResourceSpecs6  . $<<,. ? rrzID of the session to {0}.Tr0Nr)r$rQr+rrs @rAddSessionResourceArgrsP ++[)!((. ,![(rc^SmU4Sjn[RRSU"U5SRU5SS9R U5 g)z,Adds node group resource argument to parser.c,[R"SSS9$)N node_groupzNode group ID.rBrCrDrrNodeGroupConfig0AddNodeGroupResourceArg..NodeGroupConfigs  4 4 " rc >[R"SUSS[R[5[ 5T"5S9$)Nz-dataproc.projects.regions.clusters.nodeGroupsrT)r+r,r-rIr rJ nodeGroupsIdrK)r+rs rGetNodeGroupResourceSpec9AddNodeGroupResourceArg..GetNodeGroupResourceSpecs<  7" $;;%'!O$&  rrzID of the node group to {0}.Tr0Nr)r$rQr+rrs @rAddNodeGroupResourceArgrsP ++{+$++D1 ,![(rc,[R"SSS9$)N operationzThe Operation ID.rBrCrDrrOperationConfigrs  2 2 # rc r[R"SUSS[R[5[ 5S9$)Nz$dataproc.projects.regions.operationsrT)r+r,r-r. regionsId operationsId)rr2r3rrrLs r_GetOperationResourceSpecrs6   ,"::&("$ rcSn[RRU[U5SR U5SS9R U5 g)NrzThe ID of the operation to {0}.Tr0)r r4r5rrOr6)r$rQr+rs rAddOperationResourceArgrsH $++  ,'..t4 ,![(rcPURS[R"5USSS9 g)Nz --timeoutzClient side timeout on how long to wait for Dataproc operations. See $ gcloud topic datetimes for information on duration formats.T)ryrzr r|)r"rDuration)r$rzs rAddTimeoutFlagr s1    ! rcPURSS[R"5SSS9 g)Nz --parametersz PARAM=VALUEa A map from parameter names to values that should be used for those parameters. A value must be provided for every configured parameter. Parameters can be configured when creating or updating a workflow template. parameters)r{ryr r<rr>s rAddParametersFlagrs1       rcSnURSSSUS9 URSSSUS9 U(aURSSSUS9 gg) zDAdd mininum CPU platform flags for both master and worker instances.am When specified, the VM is scheduled on the host with a specified CPU architecture or a more recent CPU platform that's available in that zone. To list available CPU platforms in a zone, run: $ gcloud compute zones describe ZONE CPU platform selection may not be available in a zone. Zones that support CPU platform selection provide an `availableCpuPlatforms` field, which contains the list of available CPU platforms in the zone (see [Availability of CPU platforms](/compute/docs/instances/specify-min-cpu-platform#availablezones) for more information). z--master-min-cpu-platformPLATFORMF)r{r1r z--worker-min-cpu-platformz--driver-pool-min-cpu-platformNr=)r$include_driver_pool_argsrs rAddMinCpuPlatformArgsr#st  ) !    !    (  rcTSnURSS[R"SS9SUS9 g) zAdd optional components flag.a List of optional components to be installed on cluster machines. The following page documents the optional components that can be installed: https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/optional-components. z--optional-components COMPONENTc"UR5$)N)upper)vals r"AddComponentFlag..Ps  r) element_type components)r{ryr<r Nr)r$rs rAddComponentFlagrDs9 )    ,C D   rc,[R"SSS9$)NtemplatezThe workflow template name.rBrCrDrrTemplateAttributeConfigrUs  2 2 - rc r[R"SUSS[R[5[ 5S9$)Nz+dataproc.projects.regions.workflowTemplatesrT)r+r,r-r.rworkflowTemplatesId)rr2r3rrrLs r_GetTemplateResourceSpecr\s6   3"::&(13 rcU(aSOSn[RRU[U5SR U5SS9R U5 g)a2Adds a workflow template resource argument. Args: parser: the argparse parser for the command. verb: str, the verb to describe the resource, such as 'to update'. api_version: api version, for example v1 positional: bool, if True, means that the instance ID is a positional rather than a flag. rz--workflow-templatez(The name of the workflow template to {}.Tr0N)r r4r5rrOr6)r$rQr+ positionalrs rAddTemplateResourceArgrhsO"'<$++ {+077= ,![(rc [R"SUSS[R[5[R"SSS9S9$)Nz-dataproc.projects.regions.autoscalingPolicieszautoscaling policyTautoscaling_policyzThe autoscaling policy id.rB)r+r,r-r.rautoscalingPoliciesId)rr2r3rrrLs r_AutoscalingPolicyResourceSpecrzsD   5("::&($EE#0  rc [R"SUSS[R[5[R"SSS9S9$)Nz,dataproc.projects.locations.sessionTemplateszsession templateTsession_templatezThe session template name.rB)r+r,r-r.r/sessionTemplatesId)rr2r3rrrLs r_SessionTemplateResourceSpecr sD   4&"::*,!BB!0  rc[RRS[U5SR U5SS9R U5 g)zAdds a workflow template resource argument. Args: parser: the argparse parser for the command. verb: str, the verb to apply to the resource, such as 'to update'. api_version: api version, for example v1 rzThe autoscaling policy to {}.Tr0N)r r4r5rrOr6rPs rAddAutoscalingPolicyResourceArgrsE++$[1%,,T2 ,![(rc[RRS[U5SR U5SS9R U5 g)zAdds a session template resource argument. Args: parser: The argparse parser for the command. verb: The verb to apply to the resource, such as 'to update'. api_version: api version, for example v1 r zThe session template to {}.Tr0N)r r4r5r rOr6rPs rAddSessionTemplateResourceArgrsE++";/#**40 ,![(rc [RRS[U5SSS/0SS0SS9R U5 g) zAdds a workflow template resource argument. Args: parser: the argparse parser for the command. api_version: api version, for example v1 z--autoscaling-policyzThe autoscaling policy to use.r rF)command_level_fallthroughsflag_name_overridesr1N)r r4r5rr6)r$r+s r)AddAutoscalingPolicyResourceArgForClusterrsT++$[1& ZL" B, "k&)rcURR[[[[ S.5 URR S5 g)N)operationStateoperationTimestamp operationTypeoperationWarningsztable(name.segment():label=NAME, metadata.operationTimestamp():label=TIMESTAMP,metadata.operationType():label=TYPE, metadata.operationState():label=STATE, status.code.yesno(no=''):label=ERROR, metadata.operationWarnings():label=WARNINGS)) display_info AddTransforms_TransformOperationState_TransformOperationTimestamp_TransformOperationType_TransformOperationWarnings AddFormatr>s rAddListOperationsFormatr"sD##08.6 %  !OPrc(SU;aUS$SU;agg)z%Extract operation type from metadata.rgraphWORKFLOWrrDmetadatas rrrs# O $$(  rc6SU;aUSS$SU;aUS$g)z&Extract operation state from metadata.statusstaterrDr&s rrrs0  H g &&( G  rc<SU;a USSS$SU;aUS$g)z0Extract operation start timestamp from metadata. statusHistoryrstateStartTime startTimerrDr&s rrrs6 O $Q '(8 99h K  rc,SU;a[US5$g)z1Returns a count of operations if any are present.warningsr)lenr&s rr r s8 x # $$ rclURSSS9 URSSSS9 URSS SSS S 9 g ) z7Adds the arguments for enabling personal auth sessions.z--access-boundarya The path to a JSON file specifying the credential access boundary for the personal auth session. If not specified, then the access boundary defaults to one that includes the following roles on the containing project: roles/storage.objectViewer roles/storage.objectCreator roles/storage.objectAdmin roles/storage.legacyBucketReader For more information, see: https://cloud.google.com/iam/docs/downscoping-short-lived-credentials. rz--openssl-commandTzg The full path to the command used to invoke the OpenSSL tool on this machine. )r|r z--refresh-credentialsr:zO Keep the command running to periodically refresh credentials. )r!rzr|r Nr=r>s rAddPersonalAuthSessionArgsr3se   "         rc[RRRR 5nSUSU3nSSU/SQS./00n[ R "[R"U55$)zGet an access boundary limited to to a project's GCS objects. Args: project: The project ID for the access boundary. Returns: A JSON formatted access boundary suitable for creating a downscoped token. z//cloudresourcemanager.z /projects/access_boundaryaccessBoundaryRules)z!inRole:roles/storage.objectViewerz"inRole:roles/storage.objectCreatorz inRole:roles/storage.objectAdminz'inRole:roles/storage.legacyBucketReader)availableResourceavailablePermissions) r rcoreuniverse_domainGetsix text_typejsondumps)projectr: cab_resourcer5s rProjectGcsObjectsAccessBoundaryrB su%%**::>>@/*?*;:gYO, ' # "   / tzz/2 33rc0URSS[SS9 g)zdAdds the size field for resizing node groups. Args: parser: The argparse parser for the command. z--sizezNew size for a node group.T)r ryr1Nrr>s r AddSizeFlagrD<s#   (  rc&URSSSS9 g)zvAdds a graceful decommission timeout for resizing a node group. Args: parser: The argparse parser for the command. z--graceful-decommission-timeoutzAGraceful decommission timeout for a node group scale-down resize.FrNr=r>s r"AddGracefulDecommissionTimeoutFlagrFIs  ' M rc(URSSSSS9 g)zgAdds the customer provided driver pool id field. Args: parser: The argparse parser for the command. z--driver-pool-idz Custom identifier for the DRIVER Node Group being created. If not provided, a random string is generated. FN)r r1rzr=r>s rAddDriverPoolIdrHWs'   rc,[R"SSS9$)NinstancezThe instance name.rBrCrDrrInstanceConfigrKgs  2 2 $ rc r[R"SUSS[R[5[ 5S9$)NrGrJTrH)rr2r3rrKrLs r_GetInstanceResourceSpecrMns6   *"99 # % " rc[RRS[U5SR U5SS9R U5 g)NrJzThe name of the instance to {}.Tr0)r r4r5rMrOr6rPs rAddInstanceResourceArgrOzsC++{+'..t4 ,![(rc,[R"SSS9$)N gdce-clusterzThe GDCE Cluster path.rBrCrDrrGdceClusterConfigrRs  2 2 ( rc>[R"SS[5S9$)Nzgdce-cluster-locationzGDCE region for the {resource}.rrZrDrr_GdceLocationAttributeConfigrTs!  2 2 "1-/ rcr[RRS[5SSS9R U5 g)Nz--gdce-clusterz5The GDCE cluster to install the Dataproc instance on.Tr0)r r4r5_GetGdceClusterResourceSpecr6r>s rAddGdceClusterResourceArgrWs6++!#= , Krcn[R"SS[R[5[ 5S9$)Nz)edgecontainer.projects.locations.clustersrQr])rr2r3rTrRrDrrrVrVs0   1"::.0"$  r)T)F)10m)\__doc__ __future__rrrrr>googlecloudsdk.callioperr googlecloudsdk.calliope.conceptsrr (googlecloudsdk.command_lib.util.conceptsr googlecloudsdk.corer r<rrr&r)r8r?rErMrRrUrXr[r_rarergrjrlrorqrsrurrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrr"rrrr r3rBrDrFrHrKrMrOrRrTrWrVrDrrr`s5&' +/51D*  ! !13)$& )1)1@14K * BL 75  ;K/ )):)6)8 )  B" )$   ) )*( P    " J48     )r