KSrSSKJr SSKJr SSKJr SSKrSSKJr SSKJr Sr S r "S S 5r "S S 5r g)z5Utilities for building the dataproc clusters gke CLI.)absolute_import)division)unicode_literalsN) arg_parsers) exceptionscURS[R"SS/[[[[R"5[ [[[[[ [ S. S9S/SSS 9 g) N--poolsnameroles) r r machineType preemptible localSsdCount acceleratorsminCpuPlatformbootDiskKmsKey locationsminmax required_keysspecappendKEY=VALUE[;VALUE]a Each `--pools` flag represents a GKE node pool associated with the virtual cluster. It is comprised of a CSV in the form `KEY=VALUE[;VALUE]`, where certain keys may have multiple values. The following KEYs must be specified: ----------------------------------------------------------------------------------------------------------- KEY Type Example Description ------ ---------------- ------------------------ ---------------------------------------------------------- name string `my-node-pool` Name of the node pool. roles repeated string `default;spark-driver` Roles that this node pool should perform. Valid values are `default`, `controller`, `spark-driver`, `spark-executor`. ----------------------------------------------------------------------------------------------------------- The following KEYs may be specified: ---------------------------------------------------------------------------------------------------------------------------------------------------------------- KEY Type Example Description --------------- ---------------- --------------------------------------------- --------------------------------------------------------------------------------- machineType string `n1-standard-8` Compute Engine machine type to use. preemptible boolean `false` If true, then this node pool uses preemptible VMs. This cannot be true on the node pool with the `controllers` role (or `default` role if `controllers` role is not specified). localSsdCount int `2` The number of local SSDs to attach to each node. accelerator repeated string `nvidia-tesla-a100=1` Accelerators to attach to each node. In the format NAME=COUNT. minCpuPlatform string `Intel Skylake` Minimum CPU platform for each node. bootDiskKmsKey string `projects/project-id/locations/us-central1 The Customer Managed Encryption Key (CMEK) used to encrypt /keyRings/keyRing-name/cryptoKeys/key-name` the boot disk attached to each node in the node pool. locations repeated string `us-west1-a;us-west1-c` Zones within the location of the GKE cluster. All `--pools` flags for a Dataproc cluster must have identical locations. min int `0` Minimum number of nodes per zone that this node pool can scale down to. max int `10` Maximum number of nodes per zone that this node pool can scale up to. ---------------------------------------------------------------------------------------------------------------------------------------------------------------- typeactiondefaultmetavarhelp add_argumentrArgDictstr ArgBooleanintparsers 7lib/googlecloudsdk/command_lib/dataproc/gke_clusters.py AddPoolsArgr)ss     (335"! # #   &!+ 1C cURS[R"SS/[[[[R"5[ [ [[[[[ [ S. S9S/SSS 9 g) Nr r r ) r r r r rlocalNvmeSsdCountrrrrrrrrra Each `--pools` flag represents a GKE node pool associated with the virtual cluster. It is a comma-separated list in the form `KEY=VALUE[;VALUE]`, where certain keys may have multiple values. The following KEYs must be specified: ----------------------------------------------------------------------------------------------------------- KEY Type Example Description ------ ---------------- ------------------------ ---------------------------------------------------------- name string `my-node-pool` Name of the node pool. roles repeated string `default;spark-driver` Roles that each node pool will perform. [One Pool must have DEFAULT role] Valid values are `default`, `controller`, `spark-driver`, `spark-executor`. ----------------------------------------------------------------------------------------------------------- The following KEYs may be specified: ---------------------------------------------------------------------------------------------------------------------------------------------------------------- KEY Type Example Description --------------- ---------------- --------------------------------------------- --------------------------------------------------------------------------------- machineType string `n1-standard-8` Compute Engine machine type to use. preemptible boolean `false` If true, then this node pool uses preemptible VMs. This Must be `false` for a node pool with the CONTROLLER role or for a node pool with the DEFAULT role in no node pool has the CONTROLLER role. localSsdCount int `2` The number of local SSDs to attach to each node. localNvmeSsdCount int `2` The number of local NVMe SSDs to attach to each node. accelerator repeated string `nvidia-tesla-a100=1` Accelerators to attach to each node, in NODE=COUNT format. minCpuPlatform string `Intel Skylake` Minimum CPU platform for each node. bootDiskKmsKey string `projects/project-id/locations/us-central1 The Customer Managed Encryption Key (CMEK) used to encrypt /keyRings/keyRing-name/cryptoKeys/key-name` the boot disk attached to each node in the node pool. locations repeated string `us-west1-a;us-west1-c` Zones within the location of the GKE cluster. All `--pools` flags for a Dataproc cluster must have identical locations. min int `0` Minimum number of nodes per zone that this node pool can scale down to. max int `10` Maximum number of nodes per zone that this node pool can scale up to. ---------------------------------------------------------------------------------------------------------------------------------------------------------------- rr r&s r(AddPoolsAlphaArgr-bsv     (335"#&! # #   (!. 3G r*cl\rSrSrSr\S Sj5r\S5r\S5r\S5r \S5r Sr g ) GkeNodePoolTargetsParserzGParses all the --pools flags into a list of GkeNodePoolTarget messages.c UVs/sHn[RXUU5PM nn[RU5 [R X5 [R U5 [R U5 U$s snf)aParses all the --pools flags into a list of GkeNodePoolTarget messages. Args: dataproc: The Dataproc API version to use for GkeNodePoolTarget messages. gke_cluster: The GKE cluster's relative name, for example, 'projects/p1/locations/l1/clusters/c1'. arg_pools: The list of dict[str, any] generated from all --pools flags. support_shuffle_service: support shuffle service. Returns: A list of GkeNodePoolTargets message, one for each entry in the arg_pools list. )_GkeNodePoolTargetParserParser/_ValidateUniqueNames_ValidateRoles_ValidatePoolsHaveSameLocation_ValidateBootDiskKmsKeyPattern)dataproc gke_cluster arg_poolssupport_shuffle_servicearg_poolpoolss r(r3GkeNodePoolTargetsParser.Parses}$" "H !&&xh'> @!   11%8++H<;;EB;;EB L s!A>c[5nUH?nURnX1;a[R"SSU-5eUR U5 MA g)z'Validates that pools have unique names.r z#Pool name "%s" used more than once.N)setnodePoolrInvalidArgumentExceptionadd)r= used_namespoolr s r(r4-GkeNodePoolTargetsParser._ValidateUniqueNamessPJ ]]d 11 Validates that the bootDiskKmsKey matches the correct pattern.Nz>projects/[^/]+/locations/[^/]+/keyRings/[^/]+/cryptoKeys/[^/]+r z|bootDiskKmsKey must match pattern: projects/[KEY_PROJECT_ID]/locations/[LOCATION]/keyRings/[RING_NAME]/cryptoKeys/[KEY_NAME])recompilerPconfigrmatchrrB)r=boot_disk_kms_key_patternrEs r(r77GkeNodePoolTargetsParser._ValidateBootDiskKmsKeyPatterns  " H!J     ''..6!!((77? & , ,    $ $ 3 35511 h  r*NF) __name__ __module__ __qualname____firstlineno____doc__ staticmethodr3r4r5r6r7__static_attributes__rZr*r(r/r/siO2, E E  r*r/c\rSrSrSrSSSSS.r\SSj5r\SS j5r\SS j5r \S 5r \S 5r \S 5r \S5r Srg)r2iz@Helper to parse a --pools flag into a GkeNodePoolTarget message.rH CONTROLLER SPARK_DRIVERSPARK_EXECUTOR)r controllerz spark-driverzspark-executorc.[RXX#5$)aParses a --pools flag into a GkeNodePoolTarget message. Args: dataproc: The Dataproc API version to use for the GkeNodePoolTarget message. gke_cluster: The GKE cluster's relative name, for example, 'projects/p1/locations/l1/clusters/c1'. arg_pool: The dict[str, any] generated from the --pools flag. support_shuffle_service: support shuffle service. Returns: A GkeNodePoolTarget message. )r2_GkeNodePoolTargetFromArgPoolr8r9r<r;s r(r3_GkeNodePoolTargetParser.Parses $ A Ax BBr*cURRSRXS5[R XSU5[R X5S9$)z3Creates a GkeNodePoolTarget from a --pool argument.z{0}/nodePools/{1}r r )rAr rP)rIrJformatr2 _SplitRoles_GkeNodePoolConfigFromArgPoolrjs r(ri6_GkeNodePoolTargetParser._GkeNodePoolTargetFromArgPool,s_    . .$++K&9IJ&228g=N3JL/MM  / !!r*c/n[RnU(a1[RR5nURSS05 UR S5HunUR 5W;a[ R"SSU-5eURURRRXER 555 Mw U$)zFSplits the role string given as an argument into a list of Role enums.zshuffle-serviceSHUFFLE_SERVICE;r zUnrecognized role "%s".) r2_ARG_ROLE_TO_API_ROLEcopyupdatesplitlowerrrBrrIrJrK)r8 arg_rolesr;r defined_rolesarg_roles r(rn$_GkeNodePoolTargetParser._SplitRoles9s E6LL.DDIIKm-/@ABOOC(   .11 08;= = ll    - - K KNN,- /0 ) Lr*cURR[RX5[R X5S9nSU;aUSR S5UlX RR5:waU$g)zECreates the GkeNodePoolConfig via the arguments specified in --pools.)rV autoscalingrrsN)rIGkeNodePoolConfigr2_GkeNodeConfigFromArgPool(_GkeNodePoolAutoscalingConfigFromArgPoolrwrr8r<rVs r(ro6_GkeNodePoolTargetParser._GkeNodePoolConfigFromArgPoolJs~   0 0'AA  , 1 1( E 1GF h!+.44S9f ""4466 m r*cURR5nSU;a USUlSU;a USUlSU;a USUlSU;a!URR USS9UlSU;a[RXS5Ul SU;a USUl SU;a USUl X RR5:waU$g ) zACreates the GkeNodeConfig via the arguments specified in --pools.r r rr,)rrrrN) rI GkeNodeConfigr r rGkeEphemeralStorageConfigephemeralStorageConfigr2(_GkeNodePoolAcceleratorConfigFromArgPoolrrr)r8r<rEs r(r2_GkeNodePoolTargetParser._GkeNodeConfigFromArgPoolXs    * * ,D !-0d !-0d("#O4dh&$,$5$5$O$O !45%P%7d!!2[[ ^,.d8#$%56d8#$%56d   ..00 k r*c\/nURS5HlnSU;a[R"SSU-5eURSS5upE[U5nUR UR R UUS95 Mn U$![a [R"SSU-5ef=f)zPCreates the GkeNodePoolAcceleratorConfig via the arguments specified in --pools.rs=r zaaccelerators value "%s" does not match the expected "ACCELERATOR_TYPE=ACCELERATOR_VALUE" pattern.)acceleratorCountacceleratorTypez6Unable to parse accelerators count "%s" as an integer.)rwrrBr%rrIGkeNodePoolAcceleratorConfig ValueError)r8arg_acceleratorsrarg_acceleratoraccelerator_type count_stringcounts r(rA_GkeNodePoolTargetParser._GkeNodePoolAcceleratorConfigFromArgPoolrsL+11#6 O #11 <>MNO O(7'<'rsC<&' /.D NH V` ` FGGr*