FSrSSKrSSKrSSKrSSKJrJr SSKJr SSK J r SSK J r SSK Jr SSK Jr SS K Jr SS K Jr SS KJr SS KJr SS KJr SS KJr SSKJr SSKJr SSKJr SSK J!r! SSK J"r" SSK J#r# SSK$J%r% SSK&J'r' SSK(r(Sr)Sr*\+"1Sk5r,SCSjr-Sr.Sr/SDSjr0SDSjr1SDSjr2Sr3SES jr4S!r5S"r6S#r7S$r8S%r9S&r:S'r;S(rS+r?S,r@S-rASGS.jrBS/rCS0rDS1rES2rFS3rGS4rHS5rIS6rJ\"RRRR5rMS7\MS83rOS9rPS:rQS;rRS<rSS=rTS>rU"S?S@5rV"SASB\W5rXg)Hz1Utilities for building the dataproc clusters CLI.N)DictList)encoding)utils)compute_helpers) constants) exceptions)storage_helpers)util)actions) arg_parsers)flags) resource_args) arg_utils) labels_util)log) properties)yaml) console_io)timeszgoog-dataproc-)hyperdisk-balancedhyperdisk-extreme hyperdisk-mlhyperdisk-throughput>iopssizetype throughputc [R"U5 [R"USS9 [R"XS9 [R "U5 UR SS9nUR SS9n [R"U 5 U RS[R"S S 9S S S SS9 U RS[R"S S 9S S SSS9 UR SS9n U RSSSS9 U R SS9n U RS[SS9 U R SS9n U RS[SS9 U RS[SSSS9 U RS S!/S"QS#S$S%9 U R SS9n U RS&[R"S&S'S(9[SS)S*9 U RS+[S,S9 UR SS9nURS-S.S9 URS/S0S1[!5S[R""5S29 UR SS9nURS3S4S9 URS5S6S1[!5[R""5S79 URS8S9[S:9 [$R&"US;S[S?S9 URS@[SAS9 URSBSCS1[!5[R""5S79 URSDS!/SEQSFSG9 URSHSISJSK/SLSG9 UR)5nURSMSNSOSP9 URSQSRSSSP9 URSTSUS9 URSVSWS9 U R SS9nURSXSYS9 URSZS[S9 URS\[S]S9 URS^[S_S9 UR SS9nURS`[S[R"S`SaS(9SbSc9 URSd[SeS9 URSfSgS9 URShSiS9 URSjSkS9 URSl[R*"S S 9SmSnSo9 URSp[R,"5SqSrSsSt9 URSu[R."SvSw[R0"S Sx5Sy9SzS9 URS{[R"5[R20S|S}S~9 U RSSS9 U RS[R*"S S 9SSR5SR7[8R:5SR7[8R<5[>R@S9So9 U(a [CX5 O [EX5 UR)5nURSSSS9 URSSSS9 URS/SQSS9 SnURSUS9 URSUS9 UR SS9nURSUS[R"SSS(9S9 URSUS9 SnURSU[S:9 URSU[S:9 URSU[SS9 SnURSU[S:9 URSU[S:9 URSU[SS9 SnURSU[G5SS9 URSU[G5SS9 URSU[G5SS9 U(ap[RH"U5 URSUS9 URS[SS9 URSSS9 URS[SS9 URSSS9 URSS[RJ"SSS9S9 URSSS9 URSSSS9 URSSSS9 URSSSS9 U(dURSSSS9 UR SS9nURS[RJ"SSS9S9 U(dU(a@UR SS9nURSSS9 URSSS9 URSSSS9 URSSS[LS9 UR 5n[RN"USS9 U(GaUR)5nURS[R,"5SSS9 URS[R,"5SS9 UR)5nURS[R,"5SSS9 URS[RPRRSSS9 URS[R,"5SS9 URS[RPRRSS9 URS[R,"5SS9 UR)5nURS[R,"5SS9 URS[RPRRSS9 [UU5 U(d [WU5 [RX"X5 [[X5 U(d []X5 [_U SSS9 U(aFUR S[RJ"SSS9S9nURSSSS9 URSSSS9 g g )aRegister flags for creating a dataproc cluster. Args: parser: The argparse.ArgParser to configure with dataproc cluster arguments. dataproc: Dataproc object that contains client, messages, and resources. beta: whether or not this is a beta command (may affect flag visibility) alpha: whether or not this is a alpha command (may affect flag visibility) include_deprecated: whether deprecated flags should be included include_ttl_config: whether to include Scheduled Delete and Stop (TTL) args include_gke_platform_args: whether to include GKE-based cluster args include_driver_pool_args: whether to include driver pool cluster args 35m)default) short_flagsTmutexz6 Compute Engine options for Dataproc clusters. helpz --metadata) min_lengthappendNzTMetadata to be made available to the guest operating system running on the instancesz KEY=VALUE)ractionr!r&metavarz--resource-manager-tagszcSpecifies a list of resource manager tags to apply to each cluster node (master and worker nodes). z --single-node store_truez Create a single node cluster. A single node cluster has all master and worker components. It cannot have any separate worker nodes. If this flag is not specified, a cluster with separate workers is created. r*r&zMulti-node cluster flagsz --num-workerszHThe number of worker nodes in the cluster. Defaults to server-specified.rr&z--min-num-workerszTMinimum number of primary worker nodes to provision for cluster creation to succeed.z--min-worker-fractionz[0-1]zMinimum fraction of worker nodes required to create the cluster. If it is not met, cluster creation will fail. Must be a decimal value between 0 and 1. The number of required workers will be calculated by ceil(min-worker-fraction * num_workers).)rhiddenr+r&z--secondary-worker-typeTYPE) preemptiblenon-preemptiblespotr1z'The type of the secondary worker group.)r+choicesr!r&z--num-preemptible-workerszcThe `--num-preemptible-workers` flag is deprecated. Use the `--num-secondary-workers` flag instead.warnz6The number of preemptible worker nodes in the cluster.r*rr/r&z--num-secondary-workersz4The number of secondary worker nodes in the cluster.z--master-machine-typezHThe type of machine to use for the master. Defaults to server-specified.z--master-machine-typeszTypes of machines with optional rank for master nodes to use. Defaults to server-specified.eg. --master-machine-types="type=e2-standard-8,type=t2d-standard-8,rank=0"z4type=MACHINE_TYPE[,type=MACHINE_TYPE...][,rank=RANK])r&r+rr/r*z--worker-machine-typezMThe type of machine to use for primary workers. Defaults to server-specified.z--worker-machine-typesa[Machine types](https://cloud.google.com/dataproc/docs/concepts/compute/supported-machine-types) for primary worker nodes to use with optional rank. A lower rank number is given higher preference. Based on availablilty, Dataproc tries to create primary worker VMs using the worker machine type with the lowest rank, and then tries to use machine types with higher ranks as necessary. Machine types with the same rank are given the same preference. Example use: --worker-machine-types="type=e2-standard-8,type=n2-standard-8,rank=0". For more information, see [Dataproc Flexible VMs](https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/flexible-vms))r&r+rr*z--min-secondary-worker-fractiona,Minimum fraction of secondary worker nodes required to create the cluster. If it is not met, cluster creation will fail. Must be a decimal value between 0 and 1. The number of required secondary workers is calculated by ceil(min-secondary-worker-fraction * num_secondary_workers). Defaults to 0.0001.)r&rclusterz --kms-key)namez)--secondary-worker-standard-capacity-basea{This flag sets the base number of Standard VMs to use for [secondary workers](https://cloud.google.com/dataproc/docs/concepts/compute/secondary-vms#preemptible_and_non-preemptible_secondary_workers). Dataproc will create only standard VMs until it reaches this number, then it will mix Spot and Standard VMs according to ``SECONDARY_WORKER_STANDARD_CAPACITY_PERCENT_ABOVE_BASE''.z7--secondary-worker-standard-capacity-percent-above-baseaWhen combining Standard and Spot VMs for [secondary-workers](https://cloud.google.com/dataproc/docs/concepts/compute/secondary-vms#preemptible_and_non-preemptible_secondary_workers) once the number of Standard VMs specified by ``SECONDARY_WORKER_STANDARD_CAPACITY_BASE'' has been used, this flag specifies the percentage of the total number of additional Standard VMs secondary workers will use. Spot VMs will be used for the remaining percentage.z --secondary-worker-machine-typeszTypes of machines with optional rank for secondary workers to use. Defaults to server-specified.eg. --secondary-worker-machine-types="type=e2-standard-8,type=t2d-standard-8,rank=0"z--cluster-type)standard single-node zero-scalezThe type of cluster.)r+r4r&z--tierTIERpremiumr:z Cluster tierz--imageIMAGEzThe custom image used to create the cluster. It can be the image name, the image URI, or the image family URI, which selects the latest image from the family.)r+r&z--image-versionVERSIONzIThe image version to use for the cluster. Defaults to the latest version.z--bucketz The Google Cloud Storage bucket to use by default to stage job dependencies, miscellaneous config files, and job driver console output when using this cluster. z --temp-bucketz The Google Cloud Storage bucket to use by default to store ephemeral cluster and jobs data, such as Spark and MapReduce history files. z --networkz The Compute Engine network that the VM instances of the cluster will be part of. This is mutually exclusive with --subnet. If neither is specified, this defaults to the "default" network. z--subnetzs Specifies the subnet that the cluster will be part of. This is mutally exclusive with --network. z--num-worker-local-ssdsz?The number of local SSDs to attach to each worker in a cluster.z--num-master-local-ssdsz>The number of local SSDs to attach to the master in a cluster.z#--num-preemptible-worker-local-ssdszwThe `--num-preemptible-worker-local-ssds` flag is deprecated. Use the `--num-secondary-worker-local-ssds` flag instead.z\ The number of local SSDs to attach to each secondary worker in a cluster. )rr/r*r&z!--num-secondary-worker-local-ssdsz^ The number of local SSDs to attach to each preemptible worker in a cluster. z--master-local-ssd-interfacezR Interface to use to attach local SSDs to master node(s) in a cluster. z--worker-local-ssd-interfacezO Interface to use to attach local SSDs to each worker in a cluster. z&--secondary-worker-local-ssd-interfacez_ Interface to use to attach local SSDs to each secondary worker in a cluster. z--initialization-actionsCLOUD_STORAGE_URIzVA list of Google Cloud Storage URIs of executables to run on each node in the cluster.rr+r&z--initialization-action-timeoutTIMEOUT10mzuThe maximum duration of each initialization action. See $ gcloud topic datetimes for information on duration formats.)rr+r!r&z --num-mastersc[U5S;$)N)r')int)ns 3lib/googlecloudsdk/command_lib/dataproc/clusters.py#ArgsForClusterRef..s CFf$z?Number of masters must be 1 (Standard) or 3 (High Availability)rFparserz The number of master nodes in the cluster. Number of Masters | Cluster Mode --- | --- 1 | Standard 3 | High Availability z --propertieszPREFIX:PROPERTY=VALUEaSpecifies configuration properties for installed packages, such as Hadoop and Spark. Properties are mapped to configuration files by specifying a prefix, such as "core:io.serializations". The following are supported prefixes and their mappings: Prefix | File | Purpose of file --- | --- | --- capacity-scheduler | capacity-scheduler.xml | Hadoop YARN Capacity Scheduler configuration core | core-site.xml | Hadoop general configuration distcp | distcp-default.xml | Hadoop Distributed Copy configuration hadoop-env | hadoop-env.sh | Hadoop specific environment variables hdfs | hdfs-site.xml | Hadoop HDFS configuration hive | hive-site.xml | Hive configuration mapred | mapred-site.xml | Hadoop MapReduce configuration mapred-env | mapred-env.sh | Hadoop MapReduce specific environment variables pig | pig.properties | Pig configuration spark | spark-defaults.conf | Spark configuration spark-env | spark-env.sh | Spark specific environment variables yarn | yarn-site.xml | Hadoop YARN configuration yarn-env | yarn-env.sh | Hadoop YARN specific environment variables See https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/cluster-properties for more information. )rr*r!r+r&z--service-accountz,(optional)size=,(optional)iops=, (optional)throughput=, separated by semicolon. Allowed disk types are: hyperdisk-balanced, hyperdisk-extreme, hyperdisk-ml, hyperdisk-throughput. Example: type=hyperdisk-balanced,iops=1000,throughput=500,size=100G;type=hyperdisk-throughput,size=2000G' z--master-attached-disksz--worker-attached-disksz!--secondary-worker-attached-disksz--driver-pool-boot-disk-typez--driver-pool-sizez$The size of the cluster driver pool.z--driver-pool-machine-typez[The type of machine to use for the cluster driver pool nodes. Defaults to server-specified.z--num-driver-pool-local-ssdszU The number of local SSDs to attach to each cluster driver pool node. z!--driver-pool-local-ssd-interfacezV Interface to use to attach local SSDs to cluster driver pool node(s). z--enable-component-gatewayzaEnable access to the web UIs of selected components on the cluster through the component gateway.z;Component gateway is only supported in the default universer! universe_helpz --node-groupz The name of the sole-tenant node group to create the cluster on. Can be a short name ("node-group-name") or in the format "projects/{project-id}/zones/{zone}/nodeGroups/{node-group-name}". z--shielded-secure-bootzF The cluster's VMs will boot with secure boot enabled. z--shielded-vtpmz The cluster's VMs will boot with the TPM (Trusted Platform Module) enabled. A TPM is a hardware module that can be used for different security operations, such as remote attestation, encryption, and sealing of keys. z--shielded-integrity-monitoringaH Enables monitoring and attestation of the boot integrity of the cluster's VMs. vTPM (virtual Trusted Platform Module) must also be enabled. A TPM is a hardware module that can be used for different security operations, such as remote attestation, encryption, and sealing of keys. z--confidential-computeaG Enables Confidential VM. See https://cloud.google.com/compute/confidential-vm/docs for more information. Note that Confidential VM can only be enabled when the machine types are N2D (https://cloud.google.com/compute/docs/machine-types#n2d_machine_types) and the image is SEV Compatible. z--dataproc-metastorez Specify the name of a Dataproc Metastore service to be used as an external metastore in the format: "projects/{project-id}/locations/{region}/services/{service-name}". zR Dataproc Metastore is only supported in the default universe. z BQMS flagsz--bigquery-metastore-project-idzf The project ID of the BigQuery metastore database to be used as an external metastore. z&--bigquery-metastore-database-locationz` Location of the BigQuery metastore database to be used as an external metastore. z--bigquery-metastorezA Indicates that BigQuery metastore is to be used. z--enable-node-groupszp Create cluster nodes using Dataproc NodeGroups. All the required VMs will be created using GCE MIG. )r/r&rv1) api_versionz --max-idlez The duration after the last job completes to autto-delete the cluster, such as "2h" or "1d". See $ gcloud topic datetimes for information on duration formats. )rr/r&z--delete-max-idlez The duration after the last job completes to auto-delete the cluster, such as "2h" or "1d". See $ gcloud topic datetimes for information on duration formats. z --max-agez The lifespan of the cluster, with auto-deletion upon completion, such as "2h" or "1d". See $ gcloud topic datetimes for information on duration formats. z--expiration-timez The time when the cluster will be auto-deleted, such as "2017-08-29T18:52:51.142Z." See $ gcloud topic datetimes for information on time formats. z--delete-max-agez--delete-expiration-timez The time when the cluster will be auto-deleted, such as "2017-08-29T18:52:51.142Z." See $ gcloud topic datetimes for information on time formats. z--stop-max-idlez The duration after the last job completes to auto-stop the cluster, such as "2h" or "1d". See $ gcloud topic datetimes for information on duration formats. z--stop-max-agez The lifespan of the cluster, with auto-stop upon completion, such as "2h" or "1d". See $ gcloud topic datetimes for information on duration formats. z--stop-expiration-timez The time when the cluster will be auto-stopped, such as "2017-08-29T18:52:51.142Z." See $ gcloud topic datetimes for information on time formats. z+Specifies the reservation for the instance.z)The type of reservation for the instance.) group_text affinity_texta Options for creating a GKE-based Dataproc cluster. Specifying any of these will indicate that this cluster is intended to be a GKE-based cluster. These options are mutually exclusive with GCE-based options. zs GKE-based clusters are only supported in the default universe. )r/r&z --gke-clusterz Required for GKE-based clusters. Specify the name of the GKE cluster to deploy this GKE-based Dataproc cluster to. This should be the short name and not the full path name. z--gke-cluster-namespacez Optional. Specify the name of the namespace to deploy Dataproc system components into. This namespace does not need to already exist. )0rAddCreateLabelsFlagsrAddTimeoutFlagAddZoneAndExcludedZonesFlagsAddComponentFlagadd_argument_groupinstances_flags AddTagsArgs add_argumentr ArgDictrGfloatr DeprecationActionArgMultiValueDict FlattenActionkms_resource_argsAddKmsKeyResourceArgadd_mutually_exclusive_groupArgListDurationCustomFunctionValidator BoundedInt UpdateActionformatjoinrMINIMUM_SCOPE_URISADDITIONAL_DEFAULT_SCOPE_URISr SCOPES_HELP_AddDiskArgsDeprecated _AddDiskArgsDiskConfigParserAddDriverPoolIdUniverseHelpTextbool)AddAutoscalingPolicyResourceArgForClusterDatetimeParseAddKerberosGroupAddSecureMultiTenancyGroupAddMinCpuPlatformArgs_AddAcceleratorArgs_AddMetricConfigArgsAddReservationAffinityGroup) rNdataprocbetaalphainclude_deprecatedinclude_ttl_configinclude_gke_platform_argsinclude_driver_pool_argsplatform_groupgce_platform_group node_group worker_group min_workersnum_secondary_workersmaster_machine_type_groupworker_machine_type_group image_parser netparsersecondary_worker_local_ssdsip_address_parserboot_disk_type_detailed_helpsecondary_worker_boot_disk_type(boot_disk_provisioned_iops_detailed_help.boot_disk_provisioned_throughput_detailed_helpattached_disk_detailed_helpmetastore_group bqms_groupautoscaling_groupauto_delete_idle_groupauto_delete_groupauto_stop_groupgke_based_cluster_groups rIArgsForClusterRefr9s,""6*vu-$$VL ,,4,8.%88?8 01!!   ! ,  %" !!   ! ,  ." ((t(4*    ..4N.O,   //d/;+   "    D  8 4 '999E$$!  & & %@   C% $$  A% %77d7C(( )(( WE     & & () %77d7C(( )(( eE    & & (#)( ' 9  ((M1  H   ?  '   ( aE    & & (  7 !  *%  446, 6       !33$3?)       L    K !' 9 9 9 E**+    & & /J + **)  + $   $   .     ! ,! <  '    ! J     . . $ K''1-          % %%  "F!! I"!!   ! , , FY%A%AB"KK55 &11  5"!F6<299;    !     !  )A "  &B &B%+$=$=D$=$I!!..+ '   & & /J / "..)0L/. * + 3   + 3   5 3   4 0 1 9   1 9   ; 9    !   &      &     ) &     &! &-I   3  $ - &   +  "   ' '8L            '        --D-9/  ' '    d 333FJ)  0        //111T#@@B''  ! ! # ( ''  ! ! #(;;=""  ! ! # # ""  ! ! ' ' # ""  ! ! ##"""  ! ! ' '#   ! ! #99;O    ! ! #!    ! ! ' '!6 v&f?f7 *>?,??  ) )   @ (()((!)/rLcURRRn[UR 55Vs/sH!nUS:wdM [ R "U5PM# sn$s snf)NMETRIC_SOURCE_UNSPECIFIED)messagesMetricMetricSourceValueValuesEnumsortednamesrChoiceToEnumName)rmetric_sources_enumrHs rI_GetValidMetricSourceChoicesrsf ))00LL)//12 2! ) )$i  #2  s A' A'c JSnUR5nURSS[R"[R [ U5S9SSS9 UR5nURS[R"5[RS US 9 URS S S 9 g)z5Adds DataprocMetricConfig related args to the parser.a List of metrics that override the default metrics enabled for the metric sources. Any of the [available OSS metrics](https://cloud.google.com/dataproc/docs/guides/monitoring#available_oss_metrics) and all Spark metrics, can be listed for collection as a metric override. Override metric values are case sensitive, and must be provided, if appropriate, in CamelCase format, for example: *sparkHistoryServer:JVM:Memory:NonHeapMemoryUsage.committed* *hiveserver2:JVM:Memory:NonHeapMemoryUsage.used* Only the specified overridden metrics will be collected from a given metric source. For example, if one or more *spark:executive* metrics are listed as metric overrides, other *SPARK* metrics will not be collected. The collection of default OSS metrics from other metric sources is unaffected. For example, if both *SPARK* and *YARN* metric sources are enabled, and overrides are provided for Spark metrics only, all default YARN metrics will be collected. The source of the specified metric override must be enabled. For example, if one or more *spark:driver* metrics are provided as metric overrides, the spark metric source must be enabled (*--metric-sources=spark*). z--metric-sources METRIC_SOURCE)r4TzSpecifies a list of cluster [Metric Sources](https://cloud.google.com/dataproc/docs/guides/monitoring#available_oss_metrics) to collect custom metrics.)r+rrequiredr&z--metric-overridesz#METRIC_SOURCE:INSTANCE:GROUP:METRIC)rr*r+r&z--metric-overrides-filez Path to a file containing list of Metrics that override the default metrics enabled for the metric sources. The path can be a Cloud Storage URL (example: `gs://path/to/file`) or a local file system path. r%N) add_grouprcr rlrrrrkrp)rNrmetric_overrides_detailed_helpmetric_config_groupmetric_overrides_groups rIrrs$ .((*""     $ $.x8  (# /KKM%%     % %3 ) &%% &rLc SnUS- nURS[R"[[S.S9SUR SS9S 9 URS [R"[[S.S9SUR S S9S 9 UR S S 9nURS[R"[[S.S9SUR SS9S 9 URS[R"[[S.S9SUR SS9S [R"SSS9S9 U(a=URS[R"[[S.S9SUR SS9S 9 gg)z,Adds accelerator related args to the parser.z[ Attaches accelerators, such as GPUs, to the {instance_type} instance(s). a> *type*::: The specific type of accelerator to attach to the instances, such as `nvidia-tesla-t4` for NVIDIA T4. Use `gcloud compute accelerator-types list` to display available accelerator types. *count*::: The number of accelerators to attach to each instance. The default value is 1. z--master-accelerator)rcount)specztype=TYPE,[count=COUNT]master) instance_typerBz--worker-acceleratorworkerTr#z--secondary-worker-acceleratorsecondary-workerz --preemptible-worker-acceleratorzpreemptible-workerzqThe `--preemptible-worker-accelerator` flag is deprecated. Use the `--secondary-worker-accelerator` flag instead.r5)rr+r&r/r*z--driver-pool-acceleratorz driver-poolN) rcr rdstrrGrqr`r rf)rNraccelerator_help_fmtsecondary_worker_accelerators rIrrs          (  & &X & >        (  & &X & > "(!:!:!:!F++&      (  & &5G & H, ++(      (  & &5I & J   & & ,G,& #   * ! ( (} ( E rLc SnURS[R"SS9US9 URS[R"SS9US9 URSS9nURS [R"SS9US[R "S S S 9S 9 URS [R"SS9US9 U(a$URS[R"SS9US9 gg)z%Adds disk related args to the parser.aQ The size of the boot disk. The value must be a whole number followed by a size unit of ``KB'' for kilobyte, ``MB'' for megabyte, ``GB'' for gigabyte, or ``TB'' for terabyte. For example, `10GB` will produce a 10 gigabyte disk. The minimum boot disk size is 10 GB. Boot disk size must be a multiple of 1 GB. --master-boot-disk-size10GB lower_boundr.--worker-boot-disk-sizeTr##--preemptible-worker-boot-disk-sizewThe `--preemptible-worker-boot-disk-size` flag is deprecated. Use the `--secondary-worker-boot-disk-size` flag instead.r5rr&r/r*!--secondary-worker-boot-disk-size--driver-pool-boot-disk-sizeN)rcr BinarySizer`r rf)rNrboot_disk_size_detailed_helpsecondary_worker_boot_disk_sizes rIrwrwWs "     ! !f 5 '    ! !f 5 ' %+$=$=D$=$I!!..+  ! !f 5 '   & & /J / "..)  ! !f 5 '/  &  # # 7 )rLc UR5nUR5nURS[R"SSS9[SSS9 URS[R"SSS9[SS S9 S nURS [ R "S S 9US9 URS[ R "S S 9US9 URSS9nURS[ R "S S 9US[R"SSS9S9 URS[ R "S S 9US9 U(a$URS[ R "S S 9US9 gg)z0Adds deprecated disk related args to the parser.z--master-boot-disk-size-gbznThe `--master-boot-disk-size-gb` flag is deprecated. Use `--master-boot-disk-size` flag with "GB" after value.r5Tz9Use `--master-boot-disk-size` flag with "GB" after value.r7z--worker-boot-disk-size-gbznThe `--worker-boot-disk-size-gb` flag is deprecated. Use `--worker-boot-disk-size` flag with "GB" after value.z9Use `--worker-boot-disk-size` flag with "GB" after value.a_ The size of the boot disk. The value must be a whole number followed by a size unit of ``KB'' for kilobyte, ``MB'' for megabyte, ``GB'' for gigabyte, or ``TB'' for terabyte. For example, ``10GB'' will produce a 10 gigabyte disk. The minimum size a boot disk can have is 10 GB. Disk size must be a multiple of 1 GB. rrrr.rr#rrrrrN)rkrcr rfrGr rr`)rNrmaster_boot_disk_sizeworker_boot_disk_sizerrs rIrvrvs ==? ==?$$"  & & &J   F% $$"  & & &J   F% " $$  ! !f 5 '% $$  ! !f 5 '% %+$=$=D$=$I!!..+  ! !f 5 '   & & /J / "..)  ! !f 5 '/  &  # # 7 )rLcg)z9Register beta-only flags for creating a Dataproc cluster.NrMs rIBetaArgsForClusterRefrsrLc .Sn Sn Sn Sn UR(a`SURR5;aURSn O[R"S5eURR SS5n UR (a`SUR R5;aUR Sn O[R"S5eUR R SS5n[ URUR5nU(aBSUR5;aUSn O[R"S5eUR SS5nUR(a6URS:dURS:a[R"S 5e[US 5(aqUR(a`SURR5;aURSn O[R"S 5eURR SS5nUR=(a URURS U0S S9nUR=(a URURS U0SS9nUR=(aJ URURU[ R"R$R&R(S.SS9n[*R,"UR.5S-nUR0=(d /Vs/sHnUR2R5UUS9PM nnU=R6UR.[9U5-- sl[:R<"UR>5nUR2RAURBS9nU(a URDnOSnURF(a [HRJ"URF5nU(a URLnOSnURN(a [HRJ"URN5nRJ"[ URPURR55nSn[US5(a1URT(a [HRJ"URT5nURV(dURXS:XaSUR [ZR\'UR^b>[aUR^5Rc5UR [ZRd'UR (aC[fRh"UR UR2R@RjSS9UlURl(aXUR2R@nURnRq[s[uURvURl555 UR2RyU=(a UR{5U=(a UR{5[}XR~5URU[ R"R$RR)5URS9nUR(aUR(+UlDUR(aURUlD[X5n U UlGUR(aURUlHUR(a[R"5n!URH"n"U"R5H un#n$U$U!U#'M M$ [fRh"U!UR2RxR5UlNUR(a[R"5n%URH"n"U"R5H un#n$U$U%U#'M M$ [fRh"U%UR2RxR5UlO/n&U (a)U&RUR2RU W S95 /n'U (a)U'RUR2RU WS95 /n(U (a)U(RUR2RU WS95 /n)U (a)U)RUR2RU WS95 UR2RURUR[XR5[XR5UUR2RURU=(a UR{5URU&[UURUURURSURURUR5 UR[USURS5S9UR2RURXURU=(a UR{5URU'[UURUURURSURURUR5 UR[USURS5S 9UUS!9 n*UR(a2UR2RURS"9U*RlsUR(d#UR(dUR(Ga UR2R5U*lxUR(a%[XR5U*RlzOUR2R5n+UR(aURU+l|OSU+l|UR(aRURU+l}URRR5n,U,(aU,GR5U+lU+U*RlzU(Gds[ZGRUR ;aLUGR(d:UGR(d([R"S#[ZGR-5eUGR(dUGR(aU*RcUR2R5U*lxUGR(a'G[ XGR5U*RlOG[UGR5n-UR2GR5n.[fRh"U-UR2GRGR5U.lU.U*RlUGR(aQUR2GRURGRR5GR5S$9U*lUGR(a*UR2GRUGRS%9UlUGR#S&5(d.UGR#S'5(dUGR#S(5(aBUR2GR%UGR&UGR(UGR*S)9UlU(dAUGR#S*5(a*UR2GR/UGR0S+9UlUGR4(a+UR2GR7UGR4S,9U*lOhU(dU(aZUGR:c UGR<cUGR>(a,G[AUU5n/UR2GR7U/S-9U*lU(Ga)UR2GRC5n0S.n1UGRDb+[*R,"UGRD5S-U0lSn1UGRHb*G[JGRL"UGRH5U0lSn1UGRPb+[*R,"UGRP5S-U0lSn1UGRTb+[*R,"UGRT5S-U0lSn1UGRVb*G[JGRL"UGRV5U0lSn1UGRXb+[*R,"UGRX5S-U0lSn1UGRZb+[*R,"UGRZ5S-U0lSn1UGR^b*G[JGRL"UGR^5U0lSn1UGRbb+[*R,"UGRb5S-U0lSn1U1(aU0U*lUR2GRi5n2[URS/5(aURGRjR5n3U3(aU3GR5U2lOCS0H=n4G[oUU4GRqS1S25S5(dM)[R"S35e [URS45(aURGRrR5n5U5(aU5GR5U2lOCS5H=n4G[oUU4GRqS1S25S5(dM)[R"S65e U2GRl(dU2GRt(aU2U*l[ UGRxUGRz5n6[ UGR|UGR~5n7[ UGRUGR5n8U6cTUcQU7cNU8cKURc>UGRS7:Xd-UGRS8:XdUGRcUGRb[UG[UUGRUGR5UGRS95n9G[X5n:UR2RU6U([UU7UU8UGRS:UGRUGRUGR5 URG[XGR5U9U:S;9U*lG[UU5(Ga+UR2GRUR2GRG[GR"XR2GRGR5UR2GRGRGR/UR2RUGRU=(a UR{5UGRU)[UUGRUUGRUGRS<5UGRS=9S>9UGRS?9/U*lUGR(a*UR2GRUGRS@9U*lU(aUGRbUR=(d UR&n;SAGRUU;UGR5n&>&B  " "7  T,--$2N2N --2244%)%A%A&%I"  $ $%L MM$($@$@$D$DWa$P! jj.44 jj)Z0=M5) !2!8!8 ll $#"9"+ ;;#4#:#: kk%%--44>>' $;$. d@@ACG+ --33 4#00{14 ,,$44s<7HHH,#66t{{C/%%44%%5/#<<# (2243M3MN#<<# (2243M3MN'0':':  . .  0 0($#' d011  ) )$-$7$7 ''%! ))Q.>DDOOI99: (=@ > eg OOI99: __!)!I!I ((88"O  __"++::&&-- #NN   ((997!5!5!7"@~'>'>'@9 88))*'',,668":::  ,0,B,B(B% __(,%/?+?( YY"ii '')I++++-$!Q !  , 00     . . G G * ]]++-M++-$!Q a #+"J"Jx((99GG#++65 ,  ++65 ,  #%&!((++@? ,   !##++;: , $$22;;!! +<+<=!(II6)$$88''5!3!3!511*"((&((--44::((  55$@d77% #9*$$88''..5!3!3!511*"((&((--44::((  55$@d77% %9,)$e33.j 080A0A0O0O%)%=%=1P1N-     2 2 2$,$5$5$D$D$FN!   5L --6n##2!))88:o  )-)=)=&)-& 2 2  5 5 0 ==99??A &6&C&C&E/ #5Dn##2 774??J666)))  $ $   ; ; <     D$J$J$J  & & .(0(9(9(H(H(J% " " "7N //8 %%4 C66  % #++::<  4 4,!!00OO  1 8G%%4 '/'8'8'J'J--2288:GGI(K(N$ ___+3+<+<+N+N__,O,(  -..  / * *  9 : : 00!66))&*&H&H 1 - $""#9::44&*&?&? 5 1  %-%6%6%F%F!%!8!8&G&N"  ((4 2 2 > 1 !&.%6%6%F%F 9&G&N"((88:N ||'*}}T\\'BS'H$n '(-(<(<   )%n }} '*}}T]]'Cc'I$n & --++ ,s 2$n "".(-(<(<  % %)%n ' --,, - 3$n $%(]]43D3D%E%K"n   ,&+&:&:  # #'#n %%(]]43E3E%F%L"n'7n$''88: T]],--]]11779N*8*E*E*G'' 4c2D 9 9((9   T]]I&&mm##))+G!(!5!5!7' 4c2D 9 9(()MN N&&&*;*B*B*B&7N#(   $">">%2 ** ,,%!%2 ** ,,%! ' + 7 ( 4 ( 4 % % 1 # #'8 8 # #v - , , 8 + + 7">   8 8  F F ++ #&h5N--.6$/2/99"@@FF44  77:44'B(' . (2%T+HII,,!!++&66//99EE!))33QQXX%-$5$5$I$I%)%:%:!*!Cy/A/A/C'+'D'D%=#0$ ;;9 ;; @@) $(,'H'H%J%,2++7 - *N&@ """$,$5$5$D$D!::%E%N! #)dkkhDKK h 0 0)1(9(9(J(J(0(9(9(W(W1#99)X) )K)n% )-n%$(n!$(n!-1n* $%%%T>8< Ks$A]5cDUR(a UR$UR(aqURRS5(a![R"UR5nO[ R "URSS9nURS5$/$)zDGets metric overrides from from input file or metric_overrides list.gs://Fbinary )metric_overridesmetric_overrides_file startswithr ReadObjectrReadFromFileOrStdinsplit)rdatas rI_GetMetricOverridesr(?s~      !!,,W55  ' '(B(B Cd  + +  $ $Ud ::d  )rLc Sn[5n[U5Vs/sH)oUR5(dMUR5PM+ nnU(a/nURVs/sH o"U5PM n nUHNn U R S5Sn X;aUR U 5 UR U /5R U 5 MP U(a=[R"SSRU5-S-SRU 5-5eURR/S9Ul URHn U"U 5n URU /5nURRR URR[ R""U URRR$5US95 M g s snfs snf) a.Method to set Metric source and the corresponding optional overrides to DataprocMetricConfig. Metric overrides can be read from either metric-overrides or metric-overrides-file argument. We do basic validation on metric-overrides : * Ensure that all entries of metric-overrides are prefixed with camel case of the metric source. Example : "sparkHistoryServer:JVM:Memory:NonHeapMemoryUsage.used" is valid metric override for the metric-source spark-history-server but "spark-history-server:JVM:Memory:NonHeapMemoryUsage.used" is not. * Metric overrides are passed only for the metric sources enabled via args.metric_sources. Args: args: arguments passed to create cluster command. cluster_config: cluster configuration to be updated with DataprocMetricConfig. dataproc: Dataproc API definition. cUR5R5RSS5RSS5nUSR5USS-$)Nr r rr')rAtitler)ms title_cases rI_GetCamelCaseMetricSource;_SetDataprocMetricConfig.._GetCamelCaseMetricSourcedsN!!#++C4< 11rL:rz Found invalid metric overrides: ,z~. Please ensure the metric overrides only have the following prefixes that correspond to the metric-sources that are enabled: )metrics) metricSourcemetricOverridesN)dictr(striprr&r) setdefaultr r rrrDataprocMetricConfigdataprocMetricConfigr!r3rr ChoiceToEnumr)rr rr/metric_source_to_overrides_dictmr!invalid_metric_overridesr-valid_metric_prefixesmetricprefix metric_sourcemetric_source_in_camel_cases rIrrNs,2%)F!)US:Xa%URRRS5$US:Xa%URRRS5$US:Xa%URRRS5$Ucg[R"SU-5e) zGet ClusterType enum value. Converts cluster_type argument value to ClusterType API enum value. Args: dataproc: Dataproc API definition cluster_type: argument value Returns: ClusterType API enum value r:STANDARDr; SINGLE_NODEr< ZERO_SCALENz'Unsupported --cluster-type flag value: )rraClusterTypeValueValuesEnumr r )rres rIrdrdsZ    * * E E ]"    * * E E \!    * * E E    / rLcUS:Xa%URRRS5$US:Xa%URRRS5$Ucg[R"SU-5e)zGet ClusterTier enum value. Converts cluster_tier argument value to ClusterTier API enum value. Args: dataproc: Dataproc API definition cluster_tier: argument value Returns: ClusterTier API enum value r>CLUSTER_TIER_PREMIUMr:CLUSTER_TIER_STANDARDNz'Unsupported --cluster-tier flag value: )rraClusterTierValueValuesEnumr r )r cluster_tiers rIrfrfsY    * * E E Z    * * E E    /,> rLc>US:Xa%URRRS5$US:Xa%URRRS5$US:Xa%URRRS5$Ucg[R"SU-5e) aGet PrivateIpv6GoogleAccess enum value. Converts private_ipv6_google_access_type argument value to PrivateIpv6GoogleAccess API enum value. Args: dataproc: Dataproc API definition private_ipv6_google_access_type: argument value Returns: PrivateIpv6GoogleAccess API enum value rSINHERIT_FROM_SUBNETWORKrTOUTBOUNDrU BIDIRECTIONALNz:Unsupported --private-ipv6-google-access-type flag value: )rrK&PrivateIpv6GoogleAccessValueValuesEnumr r )rrNs rIrMrMs%(<<    - - T T! % 2    - - T T %7    - - T T %,   B'( rLc^URRURURS9$)zGet BigQuery config. Args: dataproc: Dataproc object that contains client, messages, and resources args: arguments of the request Returns: bigquery_config: BigQuery config. ) projectIdr)rBigqueryMetastoreConfigrrrrs rIrr s4    2 22288 3 rLc $UbGUb"US:wa[R"USUS35eUS::a[R"USUS35eUbGUb"US:wa[R"USUS35eUS::a[R"USUS35e/n U(GaUGHn URR5n URRR S5U lU R S 5S:Xa*URRR S 5U lU R S 5S :Xa*URRR S 5U lU R S 5S :Xa*URRR S5U lU R S 5S:Xa*URRR S5U lU R S5n U (a[U 5U lU R S5n U (a[U 5U l U R S5nU(a[U5U l U RU 5 GM URRUUUUUUU S9$)a]Get dataproc cluster disk configuration. Args: dataproc: Dataproc object that contains client, messages, and resources boot_disk_type: Type of the boot disk boot_disk_size: Size of the boot disk num_local_ssds: Number of the Local SSDs local_ssd_interface: Interface used to attach local SSDs node_type: Type of the dataproc node. One of Master, Worker, Secondary worker, Driver pool boot_disk_provisioned_iops: Provisioned IOPS of the boot disk boot_disk_provisioned_throughput: Provisioned throughput of the boot disk attached_disk_configs: Attached disks of the node. Returns: disk_config: Dataproc cluster disk configuration Raises: exceptions.ArgumentError: If boot_disk_provisioned_iops or boot_disk_provisioned_throughput is specified with boot_disk_type other than hyperdisk-balanced or if the value is not positive. rzU bootdisk IOPS can be specified only with bootdisk type hyperdisk-balanced, provided .rz* bootdisk IOPS must be positive, provided z[ bootdisk throughput can be specified only with bootdisk type hyperdisk-balanced, provided z0 bootdisk throughput must be positive, provided DISK_TYPE_UNSPECIFIEDrHYPERDISK_BALANCEDrHYPERDISK_EXTREMEr HYPERDISK_MLrHYPERDISK_THROUGHPUTrrr) bootDiskTypebootDiskSizeGbbootDiskProvisionedIopsbootDiskProvisionedThroughput numLocalSsdslocalSsdInterfaceattachedDiskConfigs) r r rAttachedDiskConfigDiskTypeValueValuesEnumdiskTyper!rG diskSizeGbprovisionedIopsprovisionedThroughputr) DiskConfig)rboot_disk_typeboot_disk_sizenum_local_ssdslocal_ssd_interface node_typeboot_disk_provisioned_iops boot_disk_provisioned_throughputattached_disk_configsattached_disk_configs_messagesattached_disk_configdisk disk_sizerrs rIrkrksB +!n8L&L  $ $ K++9*:! =  "Q&  $ $ K( ) ,  &1!n8L&L  $ $ K00>/?q B  (1,  $ $ K. /q 2  $&  5    1 1 3d    . . F F%  m  ! !& )-A A    0 0 H H$   ! !& )-@ @    0 0 H H#   ! !& )^ ;    0 0 H H   ! !& )-C C    0 0 H H&  '**62i i. ! % %f -d "4y'++L9j %(_"$++D1Q!6T    % %!#8$D!+8 & rLcnUcUcg/nU(a [XU5nURRUUS9$)aGet instance flexibility policy. Args: dataproc: Dataproc object that contains client, messages, and resources provisioning_model_mix: Provisioning model mix for instance flexibility policy machine_types: Machine types with rank for instance selection node_type: Type of the dataproc node. One of master, worker, secondary-worker Returns: InstanceFlexibilityPolicy of the secondary worker group. N)instanceSelectionListprovisioningModelMix)GetInstanceSelectionListrInstanceFlexibilityPolicy)rprovisioning_model_mix machine_typesrxinstance_selection_lists rIrsrssQ(# (= 6    4 431 5 rLchUcUcgURRU=(d SU=(d SS9$)avGet provisioning model mix from given parameters. Args: dataproc: Dataproc object that contains client, messages, and resources standard_capacity_base: Standard capacity base for provisioning model mix standard_capacity_percent_above_base: Standard capacity percent above base for provisioning model mix Returns: ProvisioningModelMix of with given parameters. Nr)standardCapacityBase standardCapacityPercentAboveBase)rProvisioningModelMix)rstandard_capacity_base$standard_capacity_percent_above_bases rIrrsA$$ . 6     / /27a . 3! 0 rLcdURcgURRURS9$)zGet startup config. Args: dataproc: Dataproc object that contains client, messages, and resources args: arguments of the request Returns: startup_config: Startup config of the secondary worker group. Nr)rrrr^s rIrrs: ''/     ( (#'#E#E ) rLc[R"5nURUURURUUS9nUR R RU5n U(a9[RRSRXR55 g[R"UU SUS9n URRURURUR S9n UR R R#U 5nURR$URR&R(R*:XGaDU(aeUR,R.bN[R0"USRUR,R.R2R45S9 U$UR6bpUR6R8R.bL[R0"US RUR6R8R.R:5S9 U$UR,R<R>n U RAS 5S n [R0"US RU 5S9 U$[RB"S 5 URRD(a-[RB"SURRD-5 U$)agCreate a cluster. Args: dataproc: Dataproc object that contains client, messages, and resources cluster_ref: Full resource ref of cluster with name, region, and project id cluster: Cluster to create is_async: Whether to wait for the operation to complete timeout: Timeout used when waiting for the operation to complete enable_create_on_gke: Whether to enable creation of GKE-based clusters action_on_failed_primary_workers: Action to be performed when primary workers fail during cluster creation. Should be None for dataproc of v1beta2 version Returns: Created cluster, or None if async )r8rr request_id action_on_failed_primary_workersz$Creating [{0}] with operation [{1}].Nz&Waiting for cluster creation operation)message timeout_s)r\r clusterNamez"Cluster created on GKE cluster {0})detailsz+Virtual Cluster created on GKE cluster: {0}/zCluster placed in zone [{0}]zCreate cluster failed!z Details: )#r GetUniqueIdGetCreateClusterRequestr\rclientprojects_regions_clustersCreaterstatuswriterqr9WaitForOperationr)DataprocProjectsRegionsClustersGetRequestrGetstate ClusterStatusStateValueValuesEnumRUNNINGconfigrCreatedResourcerrvirtualClusterConfigkubernetesClusterConfiggkeClusterTargetrrr&errordetail) r cluster_refr8is_asyncr2enable_create_on_gkerrrequest operation get_requestzone_urizone_short_names rI CreateClusterrs}4!*  , ,&&   'G - 'oo77>>wG) JJ.55    ##6 )!!KK%%   ))L+ OO 5 5 9 9+ F' ^^%%::BB ? ? K  6==nn--KK\\ B .7  % % 1  & & > > O O   AHH,,DDUUff , .0088h s+B/o  177H  .II&'~~ ii w~~4445 .rLc~UR(a[R"UR5n/nUH0nUR[5(dMUR U5 M2 UHnX$ M U(dSUlg[R "X!RRR5Ulgg)zFilter out Dataproc-generated cluster labels. Args: cluster: Cluster to filter dataproc: Dataproc object that contains client, messages, and resources N) rrMessageToPyValuer#GENERATED_LABEL_PREFIXr)rCrClusterr)r8rrlabels_to_deletelabels rIDeleteGeneratedLabelsrB s ^^  & &w~~ 6F   0 1 1&" -" gn?? ##++77gnrLcURRR(a [X5 UR R RR(a [X5 gg![a NIf=f![a gf=f)zFilter out Dataproc-generated cluster properties. Args: cluster: Cluster to filter dataproc: Dataproc object that contains client, messages, and resources N) rrr!_DeleteClusterGeneratedPropertiesAttributeErrorrrkubernetesSoftwareConfig(_DeleteVirtualClusterGeneratedProperties)r8rs rIDeleteGeneratedPropertiesrZ sw ~~$$//': $$<<UU``.wA a      s"0A/:A?/ A<;A<? B  B c[R"URRR5nSnUR 5Vs/sHnUR U5(dMUPM nnUHnX& M U(dSURRlg[R"X!RRR5URRlgs snf)z>Removes Dataproc generated properties from GCE-based Clusters.)z&hdfs:dfs.namenode.lifeline.rpc-addressz$hdfs:dfs.namenode.servicerpc-addressN) rrrrrrr#rCrr6rDr8rpropsprop_prefixes_to_deleteprop_keyprop_keys_to_deleteprops rIrrq s  # #GNN$A$A$L$L M%jjl"(   4 5" "d " /3GNN!!, 00 $$33CC  NN!!,s C+'C+c[R"URRRR 5nSnUR 5Vs/sHnURU5(dMUPM nnUHnX& M U(d&SURRRlg[R"X!RRR5URRRlgs snf)z>"23.$..)@A^^$67&NN+DE1556I2N488A266u=#;#?#?#O *B*F*F+'!))88*--.?F377 ' %((7&**+;<+//0DE $ $W -/%"32.!?'L)9. Q E    9 @ @ C DDEsE.. F"8%FF"cURS[R"SSS9S9nURSSS9 URS [R "S 5S9 g ) zFAdds the argument group to handle Secure Multi-Tenancy configurations.TzHSpecifying these flags will enable Secure Multi-Tenancy for the cluster.zLSecure Multi-Tenancy for clusters is only supported in the default universe.rVrz--identity-config-fileaHPath to a YAML (or JSON) file containing the configuration for Secure Multi-Tenancy on the cluster. The path can be a Cloud Storage URL (Example: 'gs://path/to/file') or a local file system path. If you pass "-" as the value of the flag the file content will be read from stdin. The YAML file is formatted as follows: ``` # Required. The mapping from user accounts to service accounts. user_service_account_mapping: bob@company.com: service-account-bob@project.iam.gserviceaccount.com alice@company.com: service-account-alice@project.iam.gserviceaccount.com ``` r%z#--secure-multi-tenancy-user-mappingaR A string of user-to-service-account mappings. Mappings are separated by commas, and each mapping takes the form of "user-account:service-account". Example: "bob@company.com:service-account-bob@project.iam.gserviceaccount.com,alice@company.com:service-account-alice@project.iam.gserviceaccount.com".N)r`r rzrctextwrapdedent)rNsecure_multi_tenancy_groups rIrr sz%88   ' '#  9 )) *$))+ ?? \ * rLc<URS5(a[R"U5nO[R"USS9n[ R "U5nURS05(d[R"S5e[R"URS05URR R"5nURR!US9nU$![a*n[R"SRU55eSnAff=f) z>Parses a identity-config-file into the IdentityConfig message.rFrrNrzQ--identity-config-file must contain at least one user to service account mapping.)r)r#r r$rr%rrrr rrqr!r rrCrrr)rrr'identity_config_datarridentity_config_data_msgs rIrr s$$W--  % %&: ;D  ) )*>u MDE99T?  ! !"@" E E  " " +  "*!I!I=rB&&EE" &..== <> "!% E    9 @ @ C DDEsC'' D1%DDc[R"5nURS5nUHCnURS5n[U5S:wa[R "S5eUSXS'ME U$)zDParses a secure-multi-tenancy-user-mapping string into a dictionary.r2r1z*Invalid Secure Multi-Tenancy User Mapping.r'r)rYrZr&r3r r )#user_service_account_mapping_stringrmapping_str_list mapping_strmappings rIrr s} "-!8!8!:9>>sC%k$G 7|q  $ $ 6 07qz , & &%rLcUc/$/nUHnSU;d US(d[R"SUS35eUSnSU;aSnOTUSn[U5S:wdUSR5(d[R"SUS35e[ US5nUR R 5nXlXVlURU5 M U$)z5Build List of InstanceSelection from the given flags.rzMissing machine type for z-machine-typesrankrr'zInvalid value for rank in ) r r r3isdigitrGrInstanceSelection machineTypesr(r))rrrxrmachine_type_configr(instance_selections rIrr s I* ((0CF0K  $ $ %i[ ? (/M (( d  (d TatAw00&&( > B  a\d!**<<>&3#"""#56++. ! rLc$\rSrSrSrSrSrSrg)rgi. zlConverts argument values into multi-valued mappings. Values for the repeated keys are collected in a list. czSnSRUS9n[R"U[R5Ulg)N=z([^{ops}]+)([{ops}]?)(.*))ops)rqrecompileDOTALL key_op_value)selfr1key_op_value_patterns rI__init__ArgMultiValueDict.__init__4 s3 C6==#=F #7CDrLcURS5Vs/sHo"R5PM nn[R"5nUHnURR U5nU(d%[ R"SRU55eURS5R5URS5URS5R5pnURU/5RU 5 M U$s snf)Nr2zInvalid flag value [{0}]r'r"rF) r&r7rYrZr5matchr ArgumentTypeErrorrqrr8r)) r6 arg_valueitemarg_listarg_dictargr;rr values rI__call__ArgMultiValueDict.__call__9 s)2)=>)= )=H>&&(H%%c*e ++ & - -c 2   ++a.   ++a. ++a.   c #r"))%0 O?sD)r5N)__name__ __module__ __qualname____firstlineno____doc__r8rC__static_attributes__rrLrIrgrg. s D rLrgct\rSrSrSrSrS\S\\\\44Sjr S\S\\\44Sjr S \\\44S jr S r g ) rxiK a Parses and validates disk configurations provided as a string. This class takes a string representing disk configurations, parses them, validates each configuration, and returns a list of dictionaries, where each dictionary represents a valid disk configuration. The expected format for the input string is a semi-colon separated list of disk configurations. Each disk configuration is a comma-separated list of key-value pairs, where the key and value are separated by an equals sign (=). Example: 'type=pd-ssd,size=100GB,iops=2000;type=pd-standard,size=5TB' Attributes: binary_size_parser: An instance of arg_parsers.BinarySize used to parse and validate disk sizes. It is initialized with a lower bound of '4GB' and suggested scales of 'GB' and 'TB'. c<[R"SSS/S9Ulg)N4GBGBTB)rsuggested_binary_size_scales)r rbinary_size_parser)r6s rIr8DiskConfigParser.__init___ s)44t DrLrBreturncU(d/$[U[5(d"[R"S[ U535eUR S5n/nUHPnUR 5nU(dMURU5nURU5 URU5 MR U$![a"n[R"SUSU35UeSnAff=f)aParses and validates a string of disk configurations. Args: value: A string containing the disk configurations, or an empty string. Returns: A list of dictionaries, where each dictionary represents a valid disk configuration. Returns an empty list if the input string is empty. Raises: exceptions.ArgumentError: If the input is not a string, if a disk configuration is invalid, or if any validation fails. z0Expected string for disk configuration, but got ;zInvalid disk configuration: z. N) isinstancerr r rr&r7_ParseKeyValuePairs ValueError_ValidateDiskDatar))r6rB disk_configsresultr disk_datars rIrCDiskConfigParser.__call__d s  i eS ! !  $ $  y0   # #If$5 6:L M & ) f 6"**,,If4E0F!0K  $ $ 6!2 34    ! l #,'//119\*+q0  $ $ &y'>&?@  1 $ " * * &&!)F"3!4Bqc :   s#FG/GG)rQN) rErFrGrHrIr8rrrrCrWrYrJrrLrIrxrxK s\& "C"Dc3h$8"HS#X<;c3h;rLrx)FFTFFF)F)FFTFF)NNN)FN)YrIrYr2rtypingrrapitools.base.pyrgooglecloudsdk.api_lib.computerr9googlecloudsdk.api_lib.dataprocrrr r r googlecloudsdk.callioper r ,googlecloudsdk.command_lib.compute.instancesrra#googlecloudsdk.command_lib.dataprocgooglecloudsdk.command_lib.kmsrri$googlecloudsdk.command_lib.util.apisr$googlecloudsdk.command_lib.util.argsrgooglecloudsdk.corerrrgooglecloudsdk.core.consolergooglecloudsdk.core.utilrr-rrd frozensetrcrrrrrwrvrrr(rrr#rrdrfrMrrkrsrrrrrrrrrrrUr*coreuniverse_domainrrrrrrrrrgobjectrxrrLrIrws8 %=;56;0+/Q5M:<#*$2* *''MN  #"DN6rRj*ZJ^  #d N  ?D 0 B8B . $%)od!H>.%)^B0 .<B+$"@##((88<<>%o%66GH|~-`*Z">&&!>:VvVrL