UJSrSSKJr SSKJr SSKJr SSKJr SSKJr SSK J r SSK J r SS K J r SS KJr \R \R""\R$R&\R$R(5"S S \R*555rS rSrSrg)z3Implementation of gcloud dataflow yaml run command.)apis) storage_api) storage_util) arg_parsers)base) dataflow_util) properties)yaml)filesc8\rSrSrSrSSS.r\S5rSrSr g ) Runz#Runs a job from the specified path.zERuns a job from the specified YAML description or Cloud Storage path.z To run a job from YAML, run: $ {command} my-job --yaml-pipeline-file=gs://yaml-path --region=europe-west1 ) DESCRIPTIONEXAMPLEScURSSSS9 URSS9nURSSS 9 URS S S 9 URS S S[R-S9 URSS[R "5[R SS9 URSSSS9 URSS[R"SS5S9 URSSS 9 URSSS 9 g) zfRegister flags for this command. Args: parser: argparse.ArgumentParser to register arguments with. job_nameJOB_NAMEz!Unique name to assign to the job.)metavarhelpTrequiredz--yaml-pipeline-fileziPath of a file defining the YAML pipeline to run. (Must be a local file or a URL beginning with 'gs://'.))rz--yaml-pipelinez.Inline definition of the YAML pipeline to run.z--region REGION_IDz*Region ID of the job's regional endpoint. z--pipeline-optionszOPTIONS=VALUE;OPTION=VALUEz$Pipeline options to pass to the job.)rtypeactionrz--jinja-variables JSON_OBJECTz1Jinja2 variables to be used in reifying the yaml.z--template-file-gcs-locationzbGoogle Cloud Storage location of the YAML template to run. (Must be a URL beginning with 'gs://'.)z^gs://.*zMust begin with 'gs://')rrz --networkztCompute Engine network for launching worker instances to run the pipeline. If not set, the default network is used.z --subnetworkzzCompute Engine subnetwork for launching worker instances to run the pipeline. If not set, the default subnetwork is used.N) add_argumentadd_mutually_exclusive_grouprDEFAULT_REGION_MESSAGErArgDict UpdateActionRegexpValidator)parsergroups lib/surface/dataflow/yaml/run.pyArgsRun.Args-sU J-P  / / / >E  F  P  822 3  ,  "'' 3   @  &8  ( ()DF   F  Mc [UR=(d 05nUR(a-[UR5nUcURUS'OX2S'OURUS'UR (aUR US'SU;aSU;a[ US5 [URS5U5nUR=(d) [RRRU5n[R"[R R"R$R'SS9UUR(UUUR*UR,S9n[RR/U5$)zyRuns the command. Args: args: The arguments that were provided to this command invocation. Returns: A Job message. yaml_pipeline_file yaml_pipelinejinja_variableszjinja-variablesTr) project_id region_idr gcs_location parametersnetwork subnetwork)dictpipeline_optionsr)_try_get_yaml_contentsr*r+_validate_yaml _get_region_from_yaml_or_defaultgettemplate_file_gcs_locationr TemplatesYAML_TEMPLATE_GCS_LOCATIONformatTemplateArgumentsr VALUEScoreprojectGetrr0r1CreateJobFromFlexTemplate)selfargsr/ yaml_contentsr-r. argumentss r$r Run.RuntsLd++1r2J ,T-D-DEm  +/+B+B '(&3?#%)$6$6j! &*&:&:j"#*$):*)LZ010'I '' G >> 4 4 ; ;I F &&$$))1155t5D! ??I >> 3 3I >>r'N) __name__ __module__ __qualname____firstlineno____doc__ detailed_help staticmethodr%r __static_attributes__rGr'r$r r s4,  -DDL.?r'r cn[R"U5ng![an[S5UeSnAff=f)Nz#yaml_pipeline must be a valid yaml.)r load Exception ValueError)r*_exns r$r5r5s6E - A E : ;DEs 4 /4c$URnSn[R"U5nU(d[R"U5$SU;aBSUS;a9USSnSU;dSU;a%[R "SR U55eU(a(U(aX#:wa[SR X255eU$[R"U5$![R a+nU(d[SR U55 SnANSnAff=f) zEGets the region from yaml pipeline or args, or falls back to default.Noptionsregion{}zlyaml pipeline contains unparsable region: {0}. Found curly braces in region. Falling back to default region.zyFailed to get region from yaml pipeline: {0}. If using jinja variables, parsing may fail. Falling back to default region.zeRegion specified in yaml pipeline options ({0}) does not match region specified in command line ({1})) rXr rQr GetRegionYAMLParseErrorr;printrS)r*rCrXoptions_region pipeline_datarUs r$r6r6s ;;&.IIm,M   $ $T **M!h- 2J&J$Y/9n  #"7!! 99?9O   &*  44:F5      &&%      F3Ks2CACD$!D  DcURS5(d[R"U5$[R"5n[ R RU5nURU5R5RS5$![a$n[SRX55 SnAgSnAff=f)z@Reads yaml contents from the specified file if it is accessable.zgs://zutf-8zUnable to read file {0} due to incorrect file path or insufficient read permissions. Will not be able to validate the yaml pipeline or determine the region from the yaml pipeline options. Error: {1}N) startswithr ReadFileContentsr StorageClientrObjectReferenceFromUrl ReadObjectreaddecoderRr]r;)r)storage_clientobj_refes r$r4r4s  & &w / /  ! !"4 55,,..  ( ( 0 01C D'  $ $W - 2 2 4 ; ;G DD    &v&8<  s"-B B>B99B>N)rLgooglecloudsdk.api_lib.dataflowrgooglecloudsdk.api_lib.storagerrgooglecloudsdk.callioperr#googlecloudsdk.command_lib.dataflowrgooglecloudsdk.corer r googlecloudsdk.core.utilr DefaultUniverseOnly ReleaseTracks ReleaseTrackGABETACommandr r5r6r4rGr'r$rxs:067/(=*$*D%%(($*;*;*@*@AD?$,,D?BD?NE!'Hr'