)k8SrSSKJr SSKJr SSKJr SSKrSSKrSSKrSSKrSSK r SSK r SSK J r SSKJr SSKJ r SSKJr SS KJr SS KJr SS KJr SS KJr SS KJr SSKJr SSKJr SSKJ r SSK!J"r" SSK#J$r$ SSK#J%r% SSK&r&Sr'Sr(\ RR"S5r*Sr+Sr,Sr-Sr.0r/"SS\R`"SS55r10S\1"SSS 9_S!\1"SSS 9_S"\1"SS#S 9_S$\1"S%S&\1"S%S&S 9\1"S'S&S 9S(.S)9_S*\1"SSS 9_S+\1"S,S#S 9_S-\1"S.SS 9_S/\1"SS#S 9_S0\1"S1S#S 9_S2\1"S3SS 9_S4\1"SSS 9_S5\1"SS&S 9_S6\1"SSS 9_S7\1"S3SS 9_S8\1"SSS 9_S9\1"SSS 9_S:\1"S,S#S 9_\1"SSS 9\1"SS#S 9\1"SSS 9\1"S,S#S 9\1"S3SS 9\1"SSS 9\1"SSS 9\1"S,S#S 9\1"SSS 9\1"SSS 9\1"SSS 9\1"S;SS 9\1"S,S#S 9\1"SS#S 9\1"SS#S 9S<.Er2\2Rg\/5 S=r4S>r5S?r6S@r7\R`"SASB5r8"SCSD\Rr5r9"SESF\95r:"SGSH\95r;"SISJ\95r<"SKSL\95r="SMSN\95r>"SOSP\95r?SQr@\RSaSRj5rBSSrCSbSTjrDSUrEScSVjrFSWrGSXrHSYrISZrJS[rKS\rLS]rMS^rN\RR4S_jrQS`rRg)dz'Common utilities for Composer commands.)absolute_import)division)unicode_literalsN)util) api_adapter) storage_api) storage_util)base)parsers)config) exceptions)execution_utils)log) console_io)resource_printer)encoding)filesv1 KUBECONFIGz#^[a-z](?:[-0-9a-z]{0,62}[0-9a-z])?$gcloudkubectlz!Unable to find [gcloud] on path! zAccessing a Cloud Composer environment requires the kubernetes commandline client [kubectl]. To install, run $ gcloud components install kubectl c4^\rSrSrSrSU4SjjrSrU=r$)SupportedAirflowVersionLc,>[[U] XX#5$N)superr__new__)cls from_version to_versionallowed_nested_subcommands __class__s /lib/googlecloudsdk/command_lib/composer/util.pyrSupportedAirflowVersion.__new__Rs (# 6 : CC)N3.0.0N)__name__ __module__ __qualname____firstlineno__ __slots__r__static_attributes__ __classcell__r$s@r%rrLs)18)-CCr'rz2from_version to_version allowed_nested_subcommandsbackfillz2.0.0)r!r"clear connectionsz3.2.0dbz2.3.0r(z2.6.3)checktrim)r!r"r# dag_statedagsz1.10.14 delete_dagz1.10.1kerberos kubernetesz2.1.4 list_dag_runsz1.10.2 list_dagszlist-import-errors list_tasksnext_executionpausepoolpoolsz1.10.15)renderrolesrunz sync-perm sync_permtask_failed_deps task_statetaskstest trigger_dagunpause upgrade_checkusers variablesversiondefaultz --namespacez-nactive GkePodStatuszname phase isReadyc\rSrSrSrSrg)Errorz-Class for errors raised by Composer commands.rNr)r*r+r,__doc__r.rr'r%rUrUs5r'rUc\rSrSrSrSrg) KubectlErrorz5Class for errors raised when shelling out to kubectl.rNrWrr'r%rZrZ=r'rZc\rSrSrSrSrg) GsutilErrorz4Class for errors raised when shelling out to gsutil.rNrWrr'r%r^r^s[[U] SRX55 g)NzOperation [{}] failed: {})rra__init__format)selfoperation_name descriptionr$s r%rdOperationError.__init__s# .$()D)K)K*%&r'r)r)r*r+r,rXrdr.r/r0s@r%rarasP&&r'rac\rSrSrSrSrg)EnvironmentCreateErrorz5Class for errors raised when creating an environment.rNrWrr'r%rkrkr\r'rkc\rSrSrSrSrg)EnvironmentDeleteErrorz5Class for errors raised when deleting an environment.rNrWrr'r%rnrnr\r'rnc\rSrSrSrSrg)InvalidUserInputErrorzGClass for errors raised when a user input fails client-side validation.rNrWrr'r%rqrqsOr'rqc[R"5n[R"USR U5US9 UR 5$)zConstructs text output listing the elements of items and a title. Args: title: string, the listing title items: iterable, the iterable whose elements to list Returns: string, text representing list title and elements. zlist[title="{0}"])out)ioStringIOrPrintregetvalue)titleitemsbufs r% ConstructListr|s9 # 3 : :5 AsK r'c## [R"5 [R"5n[R R US5n[R"[R[5n[R"[R[U5 [R"[5nURX5nUR!U5nUR"n U =(a U R$=(a U R&(+n U (aG[R(R+5(d$[-SR/UR055e[R(R3UUR0US9 Uv [R"[R[U5 SSS5 g![R"[R[U5 f=f!,(df  g=f7f)aSContext manager that manages a temporary kubeconfig file for a GKE cluster. The kubeconfig file will be automatically created and destroyed and will contain only the credentials for the specified GKE cluster. The 'KUBECONFIG' value in `os.environ` will be temporarily updated with the temporary kubeconfig's path. Consequently, subprocesses started with googlecloudsdk.core.execution_utils.Exec while in this context manager will see the temporary KUBECONFIG environment variable. Args: location_id: string, the id of the location to which the cluster belongs cluster_id: string, the id of the cluster kubecontext_override: string, the kubecontext override Raises: Error: If unable to get credentials for kubernetes cluster. Returns: the path to the temporary kubeconfig file Yields: Due to b/73533917, linter crashes without yields. kubeconfigzGUnable to get cluster credentials. User must have edit permission on {})kubecontext_overrideN)gke_utilCheckKubectlInstalledrTemporaryDirectoryospathjoinrGetEncodedValueenvironKUBECONFIG_ENV_VAR_NAMESetEncodedValuegke_api_adapter NewAPIAdapterGKE_API_VERSION ParseCluster GetCluster masterAuthclientCertificate clientKey ClusterConfigUseGCPAuthProviderrUre projectIdPersist) location_id cluster_idrtempdirr~old_kubeconfiggke_api cluster_refclusterauth missing_credss r%TemporaryKubeconfigrsu2   " !Wg|4J--bjj.EGN/rzz+BJO--o>g((Ak"";/g   dMD$:$:Mt~~Nm x55HHJJ''-vk.C.C'DF F$$    3% rzz+B-/+"!*rzz+B-/+"!s6+HA G58DG*G5= H,G22G55 H?Hc URRR(aSURRRURRRRS5S-S$URRURRRS5S-Sn[ R "[5nUR[R"55RVs/sHSnURU:XdMURURRS5S-S=(d URPMU nnU(d [S5e[U5S:XaUS$U[ R""UVs/sHnSR%U5PM snSSS9$s snfs snf) ajFinds the location ID of the GKE cluster running the provided environment. Args: env_object: Environment, the environment, likely returned by an API call, whose cluster location to extract Raises: Error: if Kubernetes cluster is not found. Returns: str, the location ID (a short name like us-central1-b) of the GKE cluster running the environment /Nz$Kubernetes Engine cluster not found.rz[{}]zLCluster found in more than one location. Please select the desired location:)rQmessage)r nodeConfiglocationrfind gkeClusterrrr ListClustersr GetProjectclustersnamezonerUlenr PromptChoicere) env_object gke_clusterrc cluster_zoneszs r%ExtractGkeClusterLocationIdrs!!**    ' ' 0 01B1B1M1M2:(55:2J2K LL!!,,Z->->-I-I.3eCj1.=.>?+  ) )/ :' ##G$6$6$89BBB! ; 7ajj!!#&*+,66B  6 77 =Q   z..!./Av}}Q/ 0sF=AF=G c^[R"5n/SQn[UUR[R RUS9 UR5RS5Vs/sH#nU(dM [URS56PM% nnURSS9 UVs/sH/nURR5S :XdM#URPM1 nnU(d [S 5eTcUS $[U4S jU55$![ an[SU-5eSnAff=fs snfs snf![ a [S 5ef=f)ajReturns the name of a running pod in a GKE cluster. Retrieves pods in the GKE cluster pointed to by the current kubeconfig context. To target a specific cluster, this command should be called within the context of a TemporaryKubeconfig context manager. If pod_substr is not None, the name of an arbitrary running pod whose name contains pod_substr is returned; if no pod's name contains pod_substr, an Error is raised. If pod_substr is None, an arbitrary running pod is returned. Pods with 'Ready: true' condition state are preferred. If there are no such pods, any running pod will be returned. Args: pod_substr: string, a filter to apply to pods. The returned pod name must contain pod_substr (if it is not None). kubectl_namespace: string or None, namespace to query for gke pods Raises: Error: if GKE pods cannot be retrieved or desired pod is not found. )getpods--outputzyjsonpath={range .items[*]}{.metadata.name}{"\t"}{.status.phase}{"\t"}{.status.conditions[?(.type=="Ready")].status}{"\n"})out_funcerr_func namespacezError retrieving GKE pods: %sN  c<URR5S:g$)Ntrue)isReadylower)xs r%GetGkePod..os!))//"3v"=r')keyrunningzZNo running GKE pods found. If the environment was recently started, please wait and retry.rc38># UHnTU;dM Uv M g7frr).0pod pod_substrs r% GetGkePod..sA|zS/@|s  zZDesired GKE pod not found. If the environment was recently started, please wait and retry.)rurvRunKubectlCommandwritererrrZrUrxsplitrSsortphaserrnext StopIteration)rkubectl_namespacepod_outargse pod_status cluster_pods running_podss` r% GetGkePodr?so. KKM' $ 5 # % ((*0066* ,lJ$$T*+6=>%$*      !Y .joo$  ? @@ ?@ A|A AA9 5 /!3 445 @ ? @@@s;.D+ D3:D3+"D8D8>D= D0D++D0=Ec0[RU5SL$)z>Returns True if the provided name is a valid environment name.N)ENVIRONMENT_NAME_PATTERNmatch)rs r%IsValidEnvironmentNamers ! ' ' -T 99r'c ^[R"[[R"5R 5nUc[R"[5nUc[ [5e[U[R"U/UQ765n[R"USUU4SjSS9nU(a [S5eg![R[R4a$n[[R "U55eSnAff=f)aShells out a command to kubectl. This command should be called within the context of a TemporaryKubeconfig context manager in order for kubectl to be configured to access the correct cluster. Args: args: list of strings, command line arguments to pass to the kubectl command. Should omit the kubectl command itself. For example, to execute 'kubectl get pods', provide ['get', 'pods']. out_func: str->None, a function to call with the stdout of the kubectl command err_func: str->None, a function to call with the stderr of the kubectl command namespace: str or None, the kubectl namespace to apply to the command Raises: Error: if kubectl could not be called KubectlError: if the invocation of kubectl was unsuccessful NTc>[TU5$r)HandleKubectlErrorStream)rrs r%r#RunKubectlCommand..s 5hDr')no_exitrruniversal_newlinesz&kubectl returned non-zero status code.)rFindExecutableOnPath_KUBECTL_COMPONENT_NAMEr Paths sdk_bin_pathrUMISSING_KUBECTL_MSGAddKubectlNamespacerArgsForExecutableToolExecPermissionErrorInvalidCommandErrorrZsix text_type)rrrr kubectl_path exec_argsretvalrs ` r%rrs.++,C,2LLN,G,GI,--.EFL # $$!66|KdKM) ) ! !D !F ? @@   ) )  - - /) s}}Q' (()s B::$DC==DcU=(d [RRnSU;aU"U5 U"S5 gU"U5 g)NzUnable to connect to the serverz> Please, check if you have connectivity to GKE control plane. )rstatusrw)rrerr_handler_funcs r%rrs=1!1!1&#-SJLSr'c&URSS5$)zBConverts an image version string to a kubernetes namespace string..-)replace) image_versions r%$ConvertImageVersionToNamespacePrefixrs   sC ((r'c[U5n/SQn[R"5n[X#R[ R R5 [UR5RS55nUHqnUR5(aURS5OSnU(dM4USR5[:XdMQUSRU5(dMlUSs $ [$)a^Checks environment for valid namespace options. First checks for the existence of a kubectl namespace based on the env image version. If namespace does not exist, then return the 'default' namespace. Args: env_image_version: str, the environment image version string. Returns: The namespace string to apply to any `environments run` commands. )rrz--all-namespacesz%--sort-by=.metadata.creationTimestamprzEjsonpath={range .items[*]}{.metadata.name}{"\t"}{.status.phase}{"\n"}z--ignore-not-found=truerrNrr)rrurvrrrrreversedrxrstriprNAMESPACE_STATUS_ACTIVE startswithDEFAULT_NAMESPACE)env_image_versionimage_version_ns_prefixr ns_output namespacesns_entryns_partss r%FetchKubectlNamespacer sA $kkm)D//377==9 **,22489*h'/~~'7'7x~~d#THXa[&&(,CC 677 a[  r'cUcU$[[1R[U55(a8SnU(a[US;aSnU[4HnUR X#5 M U$)aZAdds namespace arguments to the provided list of kubectl args. If a namespace arg is not already present, insert `--namespace ` after the `kubectl` command and before all other arg elements. Resulting in this general format: ['kubectl', '--namespace', 'namespace_foo', ... ... ] Args: namespace: name of the namespace scope kubectl_args: list of kubectl command arguments. Expects that the first element will be the `kubectl` command, followed by all additional arguments. Returns: list of kubectl args with the additional namespace args (if necessary). rr)NAMESPACE_ARG_NAMENAMESPACE_ARG_ALIAS isdisjointsetrinsert)r kubectl_argsidxnew_args r%rrso$ -.99#l:KLL C/<?B c12#'3 r'cURS5nU(aF[R"5n[RR U5nUR U5nO[R"U5n0nUnUHbnUR5nU(aURS5(aM2[U5upX;a[SRU55eXU'Md UsSSS5 $!,(df  g=f![R[R[R4a1 [R"[SRU555 gf=f)aParses the given requirements file into a requirements dictionary. If the file path is GCS file path, use GCS file parser to parse requirements file. Otherwise, use local file parser. Args: requirements_file_path: Filepath to the requirements file. Returns: {string: string}, dict mapping from PyPI package name to extras and version specifier, if provided. Raises: Error: if requirements file cannot be read. zgs://#z+Duplicate package in requirements file: {0}Nz$Unable to read requirements file {0})rr StorageClientr ObjectReferenceFromUrl ReadObjectr FileReaderrSplitRequirementSpecifierrUrecore_exceptionsreraise) requirements_file_pathis_gcs_file_pathstorage_client object_ref file_content requirementsrequirements_filerequirement_specifierpackagerPs r%ParseRequirementsFiler(s3 &-88A"002n//778NOj#..z:l%%&<=lL *#4  5 ; ; =$(=(H(H(M(M 45JK  ";BB7KM M 'W$5  ++{((,*<*< =& 4;; "$ %&&s2A8C?:A*C.$ C?. C<8C?<C??A!E#"E#c.UR5nSn[R"X 5nSnU(aAUSUR5R5nXR5SR5nU(d[ SR U55eX4$)a1Splits the package name from the other components of a requirement spec. Only supports PEP 508 `name_req` requirement specifiers. Does not support requirement specifiers containing environment markers. Args: requirement_specifier: str, a PEP 508 requirement specifier that does not contain an environment marker. Returns: (string, string), a 2-tuple of the extracted package name and the tail of the requirement specifier which could contain extras and/or a version specifier. Raises: Error: No package name was found in the requirement spec. z(\[|\(|==|>=|!=|<=|<|>|~=|===)Nz5Missing package name in requirement specifier: \'{}\')rresearchstartrUre)r&r'tail_start_regex tail_matchtails r%rr@s$ " ' ' )'6yy)A* $#$7Z%5%5%78>>@G !1!1!3!4 5 ; ; =D  HOO  r'c [SU=(d /55n[R"S[[R "U=(d 05555nU(a7[R "U5VVs/sH upgU"XgS9PM nnnX5"U54$/n [5n UH4nU R SRX655 U RU5 M6 /n[R "U5HAupgUR U"XgS95 Xj;dM!U R SRX655 MC U R5 SRU 5U"U54$s snnf)aBuilds the field mask and patch environment for an environment update. Follows the environments update semantic which applies operations in an effective order of clear -> remove -> set. Leading and trailing whitespace is stripped from elements in remove_keys and the keys of set_entries. Args: clear: bool, If true, the patch removes existing keys. remove_keys: iterable(string), Iterable of keys to remove. set_entries: {string: string}, Dict containing entries to set. field_mask_prefix: string, The prefix defining the path to the base of the proto map to be patched. entry_cls: AdditionalProperty, The AdditionalProperty class for the type of entry being updated. env_builder: [AdditionalProperty] -> Environment, A function which produces a patch Environment with the given list of entry_cls properties. Returns: (string, Environment), a 2-tuple of the field mask defined by the arguments and a patch environment produced by env_builder. c3@# UHoR5v M g7frrrks r%r%BuildPartialUpdate..x9'8!GGII'8c3J# UHupUR5U4v M g7frr3rr5vs r%rr6{!(K!Iqwwy!n!I!#rvaluez{}.{},) r collections OrderedDictsortedr iteritemsappendreaddrr) r2 remove_keys set_entriesfield_mask_prefix entry_cls env_builderrr?entriesfield_mask_entries seen_keyss r%BuildPartialUpdaterO_sK29{'8b'899+''(K!' k6GR(H!I(KK+ -- 44JC c'4  k'2 22e) cgnn->DE MM# 'MM+.jc NN923 /@ FG/  $ %{7'; ;;'s?E)c [R"SU55nU(a[R"5n[SU=(d /55nUH nXv;dM Xg M [R"S[[R "U=(d 05555nUR U5 U"[R "U5VVs/sH upxU"XxS9PM snn5$s snnf)aBuilds the patch environment for an environment update. To be used when BuildPartialUpdate cannot be used due to lack of support for field masks containing map keys. Follows the environments update semantic which applies operations in an effective order of clear -> remove -> set. Leading and trailing whitespace is stripped from elements in remove_keys and the keys of set_entries. Args: clear: bool, If true, the patch removes existing keys. remove_keys: iterable(string), Iterable of keys to remove. set_entries: {string: string}, Dict containing entries to set. initial_entries: [AdditionalProperty], list of AdditionalProperty class with key and value fields, representing starting dict to update from. entry_cls: AdditionalProperty, The AdditionalProperty class for the type of entry being updated. env_builder: [AdditionalProperty] -> Environment, A function which produces a patch Environment with the given list of entry_cls properties. Returns: Environment, a patch environment produced by env_builder. c3P# UHoRUR4v M g7frr>)rentrys r%r%BuildFullMapUpdate..s)=,;5yy%++Os$&c3@# UHoR5v M g7frr3r4s r%rrSr7r8c3J# UHupUR5U4v M g7frr3r:s r%rrSr<r=r>)rArBrrCrrDupdate) r2rGrHinitial_entriesrJrK entries_dictrr?s r%BuildFullMapUpdaterYs8(()=,;)==, **,L9{'8b'899+ c    ''(K!' k6GR(H!I(KK+k"  l33*#C%3 sC0 c[R"US9RRRnUR U:H$)a1Returns whether an environment currently is in the RUNNING state. Args: environment: Environment, an object returned by an API call representing the environment to check. release_track: base.ReleaseTrack, the release track of command. Will dictate which Composer client library will be used. ) release_track)api_utilGetMessagesModule EnvironmentStateValueValuesEnumRUNNINGstate) environmentr[ running_states r%IsInRunningStaterds<  %''2{3G3G   m ++r'cUcgUHn[R"U5 M g![an[SR U55eSnAff=f)z|Validates given master authorized networks. Args: networks: Iterable(string) or None. List of networks in CIDR notation. Nz%Invalid master authorized network: {}) ipaddress IPv4Network Exceptionrqre)networksnetworkrs r% ValidateMasterAuthorizedNetworksrksW  g=G$ = ! 1 8 8 ; ===s& AA  Ar)NN)NNN)SrX __future__rrrrA contextlibrurfrr+googlecloudsdk.api_lib.composerrr\ googlecloudsdk.api_lib.containerrrrgooglecloudsdk.api_lib.storagerr googlecloudsdk.callioper #googlecloudsdk.command_lib.composerr googlecloudsdk.corer r rrrgooglecloudsdk.core.consolergooglecloudsdk.core.resourcergooglecloudsdk.core.utilrrrrrcompiler_GCLOUD_COMPONENT_NAMErMISSING_GCLOUD_MSGrSUBCOMMAND_DEPRECATION namedtuplerSUBCOMMAND_ALLOWLISTrVrr rrrSrUrZr^rarkrnrqr|contextmanagerrrrrrrrr rr(rrOrY ReleaseTrackGArdrkrr'r%rs.&'  <K=67(7&=/#29-* &::&KL!# Ck448: CKTgFK TgF K TgF K  ,%,B,%,B ( K&TgF)K* Y7K-K.X'J1K2TgF5K6WI9K:X'J=K>TgFAKBTgFEKFTgFIKJX'JMKN TgFQKR TgFUKV Y7KYK\ TgFWITgFY7KX'JTgFTgFY7KTgFTgFTgFY7KY7KTgFTgFUK^23""%%n6JK 6O ! !6>5>=%=&U&>U>>U>PEP   ////d(VC@L: /Ad) "J F*&Z>2