9&SrSSKJr SSKJr SSKJr SSKJr SSKJr SSKJ r SSK J r SS KJr SS KJr S rSS jrSrSSjrSrSSjrSrg )z/Utilities for AI Platform custom jobs commands.)absolute_import)division)unicode_literals) local_util)build)utils) arg_utils)log)filesz(aiplatform.projects.locations.customJobsNcURS5"5nURS5nU"URS5S9nURS5nU(aE[R"XdR5Ul[ URSS55UlXSl[ URSS55Ul URS 5nURS 5nURS 5n U(aURS 5n U "US 9Ul U$U(dU(dU (a'URS5n U "UU=(d /U S9Ul U$)aConstructs the specification of a single worker pool. Args: aiplatform_client: The AI Platform API client used. spec: A dict whose fields represent a worker pool config. python_package_uri: str, The common python package uris that will be used by executor image, supposedly derived from the gcloud command flags. Returns: A WorkerPoolSpec message instance for setting a worker pool in a custom job. WorkerPoolSpec MachineSpecz machine-type) machineTypezaccelerator-typezaccelerator-countz replica-countcontainer-image-uriexecutor-image-uri python-module ContainerSpec)imageUriPythonPackageSpec)executorImageUri packageUris pythonModule) GetMessagegetr ChoiceToEnumAcceleratorTypeValueValuesEnumacceleratorTypeintacceleratorCount machineSpec replicaCount containerSpecpythonPackageSpec) aiplatform_clientspecpython_package_uriworker_pool_specmachine_spec_msg machine_specaccelerator_typecontainer_image_uriexecutor_image_uri python_modulecontainer_spec_msgpython_package_spec_msgs Alib/googlecloudsdk/command_lib/ai/custom_jobs/custom_jobs_util.py_ConstructSingleWorkerPoolSpecr2 s@'112BCE&11-@!dhh~.FG,XX01#,#9#9II$KL $'1Da(H$IL!!-"%dhh&B"C!67xx 45((?+-*55oF%7$&&" /=/::;NO)@+'-2"*$& c /nUHLnU(aUR[X40UD65 M'URURS5"55 MN U$)aConstructs the specification of the worker pools in a CustomJobSpec instance. Args: aiplatform_client: The AI Platform API client used. specs: A list of dict of worker pool specifications, supposedly derived from the gcloud command flags. **kwargs: The keyword args to pass down to construct each worker pool spec. Returns: A list of WorkerPoolSpec message instances for creating a custom job. r )appendr2r)r%specskwargsworker_pool_specsr&s r1_ConstructWorkerPoolSpecsr9Ls\d  (): KF KM0;; local_packagescriptrAr.r7 output_image push_commands r1_PrepareTrainingImagerSds#8l&D&D$'8,&&}5!$   **CDFL1,##L1**GNN  r3c#8# SnU(aSUS;aUSRS5nUSRS5nUSRSS5nU(a[R"U5nOUSRS5nUSRSS5n[UUUUUUUUSRSS5USRS S5USRS S5S 9 nUH/n U(a!U (aU R 5n X:S 'U v M+U v M1 g7f) aUpdate the given worker pool specifications if any contains local packages. If any given worker pool spec is specified a local package, this builds a Docker image from the local package and update the spec to use it. Args: worker_pool_specs: list of dict representing the arg value specified via the `--worker-pool-spec` flag. job_name: str, the display name of the custom job corresponding to the worker pool specs. project: str, id of the project to which the custom job is submitted. Yields: All updated worker pool specifications that uses the already built packages and are expectedly passed to a custom-jobs create RPC request. Nzlocal-package-pathrrrrPzoutput-image-uri requirementszextra-packagesz extra-dirs) r<rNr>rOrPrAr.rUextra_packages extra_dirsr)popr ModuleToPathrScopy) r8rNr<image_built_for_first_workerr>rOr.rPrQr&new_specs r1+UpdateWorkerPoolSpecsIfLocalPackageRequiredr]s1&"&/3DQ3GG"1%))*>?J%a(,,-ABM%a(,,_dCM&&}5f #''1f$Q'++,>EL#8#&#&q)--ndC(+//0@$G$Q'++L$? $A  d#h(D$% n j  sDDc  Un UbX+lUbX;lU(aXKlU(aX[lU(a[ X40U D6U lU(aWU R HGn U R (aX|R lU R(dM7X|RlMI U(a6U R H&n U R (dMXR l M( U (aXl U $)aConstructs the spec of a custom job to be used in job creation request. Args: aiplatform_client: The AI Platform API client used. base_config: A base CustomJobSpec message instance, e.g. imported from a YAML config file, as a template to be overridden. network: user network to which the job should be peered with (overrides yaml file) service_account: A service account (email address string) to use for the job. enable_web_access: Whether to enable the interactive shell for the job. enable_dashboard_access: Whether to enable the access to the dashboard built on the job. worker_pool_specs: A dict of worker pool specification, usually derived from the gcloud command argument values. args: A list of arguments to be passed to containers or python packge, supposedly derived from the gcloud command flags. command: A list of commands to be passed to containers, supposedly derived from the gcloud command flags. persistent_resource_id: The name of the persistent resource from the same project and region on which to run this custom job. **kwargs: The keyword args to pass to construct the worker pool specs. Returns: A CustomJobSpec message instance for creating a custom job. ) networkserviceAccountenableWebAccessenableDashboardAccessr9workerPoolSpecsr#argsr$commandpersistentResourceId) r% base_configr_service_accountenable_web_accessenable_dashboard_accessr8rdrepersistent_resource_idr7job_specr(s r1ConstructCustomJobSpecrmsL(  -0%<"8 806 8H $44  ' '.2&&+  + + +26**/ 5  $44  ' ' '18&&.5$:! /r3c LX;=(a [URU55$N)boolr)keyr7s r1_IsKwargsDefinedrrs  04 300r3ro) NNNNNNNNN)__doc__ __future__rrr)googlecloudsdk.command_lib.ai.custom_jobsr$googlecloudsdk.command_lib.ai.dockerrrGrrE$googlecloudsdk.command_lib.util.apisr googlecloudsdk.corer googlecloudsdk.core.utilr CUSTOM_JOB_COLLECTIONr2r9rSr]rmrrrDr3r1r{sw6&'@FF:#*C 7;)X<)- <1l   CL1r3