\8SrSSKJr SSKJr SSKJr SSKJr SSKrSSKrSSKrSSK r SSK r SSK r SSK r SSK r SSKJr SSKrSSKJr SS KJr SSKrSS KJr SS KJr SS KJr SS KJr SSKJr SSKJr SSKJr SSKrSSKJ r SSKJ!r! SSKJ"r" SSK#J$r$ SSK%J&r& SSK'J(r( SSK)J*r* SSK+J,r, SSK-J.r. SSK-J/r/ SSK-J0r0 SSK1J2r2 SSK1J3r3 SSK4J5r5 SSK6J7r7 SS K8J9r9 SS!K8J:r: SS"K8J;r; SS#K8Jr> SS%K?J@r@ SS&K?JArA S'rBS(rCS)rD"S*S+\E5rFg),z'Class that runs a named gsutil command.)absolute_import)print_function)division)unicode_literalsN)input)config)BucketStorageUri)metrics)CloudApiDelegator)CommandCreateOrGetGsutilLogger)GetFailureCount) OLD_ALIAS_MAP)ShutDownGsutil) ApiSelector)GsutilApiClassMapFactory)GsutilApiMapFactory)DiscardMessagesQueue)CommandException) GcsJsonApi)NoOpCredentials) MakeCompleter) boto_util) shim_util) system_util)RELEASE_NOTES_URL)UTF8)IsCustomMetadataHeader)$CheckMultiprocessingAvailableAndInit)CompareVersions)InsistAsciiHeader)InsistAsciiHeaderValue) print_to_fd)SECONDS_PER_DAY)LookUpGsutilVersion)GsutilPubTarballcU(dgUHkn[U5 [U5(a?[X[R5(dXR [ 5X'M[M][XU5 Mm g![aL [SR[R"S[U5<S[X5<S3555ef=f)aHandles coding of headers and their values. Alters the dict in-place. Converts a dict of headers and their values to their appropriate types. We ensure that all headers and their values will contain only ASCII characters, with the exception of custom metadata header values; these values may contain Unicode characters, and thus if they are not already unicode-type objects, we attempt to decode them to Unicode using UTF-8 encoding. Args: headers: A dict mapping headers to their values. All keys and values must be either str or unicode objects. Raises: CommandException: If a header or its value cannot be encoded in the required encoding. N z#Invalid encoding for header value (z: z). Values must be decodable as Unicode. NOTE: the value printed above replaces the problematic characters with a hex-encoded printable representation. For more details (including how to convert to a gsutil-compatible encoding) see `gsutil help encoding`.)r"r isinstancesix text_typedecoderUnicodeDecodeErrorrjointextwrapwrapreprr#)headerskeys 'platform/gsutil/gslib/command_runner.pyHandleHeaderCodingr6Ds"  ccc""  cmm 4 4 D ,,T2',5S#,/# " D mm #'s)T',-? AB"CD D Ds A;;ACc D[[U55H@nXn[U[R5(aM(UR [ 5X'MB g![a; [SR[R"S[U5-555ef=f)zHandles coding of command-line args. Alters the list in-place. Args: args: A list of command-line args. Raises: CommandException: if errors encountered. r)a%Invalid encoding for argument (%s). Arguments must be decodable as Unicode. NOTE: the argument printed above replaces the problematic characters with a hex-encoded printable representation. For more details (including how to convert to a gsutil-compatible encoding) see `gsutil help encoding`.N) rangelenr*r+r,r-rr.rr/r0r1r2)argsiargs r5HandleArgCodingr=ls T a 'C c3== ) ) **T"   tyy MMJ S    s AABcZ[R(aUR[5$U$)zDConverts a string literal (unicode) to the same type as sys.argv[0].)r+PY2encoder) unicode_strs r5_StringToSysArgTyperBs" WW   d ## cx\rSrSrSr\\S4SjrSrSr Sr Sr S r SS jr S rS rS rSrg) CommandRunnerz?Runs gsutil commands and does some top-level argument handling.NcbXlX lU(aX0lgUR5Ulg)aInstantiates a CommandRunner. Args: bucket_storage_uri_class: Class to instantiate for cloud StorageUris. Settable for testing/mocking. gsutil_api_class_map_factory: Creates map of cloud storage interfaces. Settable for testing/mocking. command_map: Map of command names to their implementations for testing/mocking. If not set, the map is built dynamically. N)bucket_storage_uri_classgsutil_api_class_map_factory command_map_LoadCommandMap)selfrHrIrJs r5__init__CommandRunner.__init__s*%=!(D%$--/drCc@[R"[RR5Hupn[ SU-5 M 0n[ R"5H<nXCURR'URRHnXCU'M M> U$)z=Returns dict mapping each command_name to implementing class.zgslib.commands.%s) pkgutil iter_modulesgslibcommands__path__ __import__r __subclasses__ command_spec command_namecommand_name_aliases)rL_ module_namerJcommandrYs r5rKCommandRunner._LoadCommandMaps%11%..2I2IJ${23KK))+7>'&&334")"6"6"K"K ,3()#L, rCc[S5$)z$Returns a logger for tab completion. tab_completer )rLs r5_GetTabCompleteLogger#CommandRunner._GetTabCompleteLoggers "> 22rCc^^^^^TR5mUUU4SjnUUUUU4Sjn[T[5(aU"5 g[T[5(aU"5 gSn[ UR T[ T555e)aCreates parsers recursively for potentially nested subcommands. Args: parser: argparse parser object. subcommands_or_arguments: list of CommandArgument objects, or recursive dict with subcommand names as keys. gsutil_api: gsutil Cloud API instance to use. Raises: RuntimeError: if argument is configured with unsupported completer TypeError: if subcommands_or_arguments is not a dict or list c>THWnTR"UR0URD6nUR(dM<[ URT5UlMY g)N) add_argumentr:kwargs completerr)command_argumentaction gsutil_apiparsersubcommands_or_argumentss r5 HandleListJCommandRunner._ConfigureCommandArgumentParserArguments..HandleLists\6 $$&6&;&;@'7'>'>@  % % %*+;+E+E+57&  7rCc>TR5nTR5HHupURUSS9nTRSR U55 TR UUT5 MJ g)NF)add_helpz$Constructing argument parsers for {})add_subparsersitems add_parserinfoformat(_ConfigureCommandArgumentParserArguments) subparserssubcommand_namesubcommand_valuecur_subcommand_parserriloggerrjrLrks r5 HandleDictJCommandRunner._ConfigureCommandArgumentParserArguments..HandleDictsw((*j/G/M/M/O +/ * 5 5o?D!6!F 2 9 9/ J L 556K6F6@ B 0PrCzAsubcommands_or_arguments {} should be list or dict, found type {}N)r`r*listdict TypeErrorrttype)rLrjrkrirlr{ error_formatrzs```` @r5ru6CommandRunner._ConfigureCommandArgumentParserArgumentssz  ' ' )F7 B B*D11l ,d 3 3l&l    6"#;< > ??rCcH[R[R/[R/S.n[R[RS.n[R"UR X5n[ URUUR5[5SS9nU$)zlBuilds and returns a gsutil_api based off gsutil_api_class_map_factory. Returns: the gsutil_api instance )gss3r)debug) rXMLJSONr GetApiMaprIr rHr`r)rL support_map default_mapgsutil_api_mapris r5GetGsutilApiForTabComplete(CommandRunner.GetGsutilApiForTabCompletes 0 01K%))AK(22 ));EN#4#@#@#1#'#=#=#?#7#9)* ,J rCcUR5nURR5Vs0sH.nURRURR _M0 nnUR XU5 gs snf)zConfigures argparse arguments and argcomplete completers for commands. Args: main_parser: argparse object that can be called to get subparsers to add subcommands (called just 'commands' in gsutil) N)rrJvaluesrWrXargparse_argumentsru)rL main_parserrir\command_to_argparse_argumentss r5ConfigureCommandArgumentParsers-CommandRunner.ConfigureCommandArgumentParserss002J''..0%1G ))  3 3 40"%0 11J@1%s5A7c 4Sn U(d\URX5(aFSnSn [S5/n[R"5(aU (a[R "5 UR U5 U(d/n[RRSSS5nU(d0nXS'XR;a[R"UURR5S S 9nU(aQ[R"US U5S n[!S ["R$S 9 [!SU-["R$S 9 O:US:Xa4[&R((a["R$R+S5 [-SU-5e[S5U;a\U/nURUnUR.R0R5nUHnUU;dM UR3U5 O UnSn[5U5 [7U5 URUnU"UUUUUUUR8UR:UUU U S9 nU (a*[R<"UR>UR@US9 URC5(aURE5nOURG5n[I5RJ(aU (a [M5 [O5S :aS nU (a0S n[!SRQ[RRT"S555 U$)a5Runs the named command. Used by gsutil main, commands built atop other commands, and tests. Args: command_name: The name of the command being run. args: Command-line args (arg0 = actual arg, not command name ala bash). headers: Dictionary containing optional HTTP headers to pass to boto. debug: Debug level to pass in to boto connection (range 0..3). trace_token: Trace token to pass to the underlying API. parallel_operations: Should command operations be executed in parallel? skip_update_check: Set to True to disable checking for gsutil updates. logging_filters: Optional list of logging.Filters to apply to this command's logger. do_shutdown: Stop all parallelism framework workers iff this is True. perf_trace_token: Performance measurement trace token to pass to the underlying API. user_project: The project to bill this request to. collect_analytics: Set to True to collect an analytics metric logging this command. Raises: CommandException: if errors encountered. Returns: Return value(s) from Command that was run. FupdateTz-nGSUtildefault_api_version1zx-goog-api-version)nrzDid you mean this?)filez %szgUpdate command is not supported for package installs; please instead update using your package manager.zInvalid command "%s".z--helphelp)command_alias_usedperf_trace_token user_project)rXsub_opts command_aliasr)zUpdate was successful. Exiting with code 1 as the original command issued prior to the update was not executed and should be re-run.)+#MaybeCheckForAndOfferSoftwareUpdaterBrIsRunningInteractivelyr 'CheckAndMaybePromptForAnalyticsEnablingMaybePromptForPythonUpdatebotor get_valuerJdifflibget_close_matcheskeysrgetprintsysstderrrRIS_PACKAGE_INSTALLwriter help_specsubcommand_help_textappendr=r6rHrILogCommandParamsrXr(translate_to_gcloud_storage_if_requestedrun_gcloud_storage RunCommandr is_availablerrr/r0r1)rLrXr:r3r trace_tokenparallel_operationsskip_update_checklogging_filters do_shutdownrrcollect_analyticscommand_changed_to_update api_version close_matchestranslated_command_namenew_argsoriginal_command_class subcommandsr< command_class command_inst return_codes r5RunNamedCommandCommandRunner.RunNamedCommand'sP!&  00EEl"&!$' (d  + + - -2C779##L1  d++''2GMK g$/ !+++// 040@0@0E0E0G235m $1#4#4]15E5B$DDE$G "4 f..SZZ@ 8 #(@(@  @ A 4|C DD8$,h#// =*44IINNPk# +  //#  dlDw$$\2M !%!(!&!,!4!%!>!>!%!B!B!04@2B.: >!335k!++-k+-::{1k k DII --R   rCc[R"5n[R"5(a>UR [R 5(a[ R"5(agg)aHelper function that will determine if update checks should be skipped. Args: command_name: The name of the command being run. Returns: True if: - gsutil is not connected to a tty (e.g., if being run from cron); - user is running gsutil -q - user specified gs_host (which could be a non-production different service instance, in which case credentials won't work for checking gsutil tarball).TF)logging getLoggerrr isEnabledForINFOrHasUserSpecifiedGsHost)rLrzs r5SkipUpdateCheckCommandRunner.SkipUpdateChecksK   F  . . 0 0    - -((**  rCc[RRS:wdAUR5(d,US;d&[R R SSS5(ag[S5 g)zAlert the user that they should install Python 3. Args: command_name: The name of the command being run. Returns: True if a prompt was output. )rverversionrskip_python_update_promptFzxGsutil 5 drops Python 2 support. Please install Python 3 to update to the latest version of gsutil. https://goo.gle/py3 T)r version_infomajorrrrgetboolr$)rLrXs r5r(CommandRunner.MaybePromptForPythonUpdatesb !#t';';'='=88 H&A5II  AB rCc [R"5nUR5(d US;d[R"5(ag[ R RSSS5nUS:Xag[R"5n[[R"55n[RRU5(dE[R "5n[#US5nUR%['U55 SSS5 O/[#US 5n[UR)55nSSS5 UW- U[.-:Ga[1UR2U[55[75US 9n [R8n [;U [=55n [#US5nUR%['U55 SSS5 [AU [R85upU (a[CS RE[FRH"S U <S [R8<S[J<S3555 [RL(ag[CS 5 [OS5n U =(a U RQ5SS:H$U (a[CS RE[FRH"S U <S [R8<S[J<S3555 [RL(ag[CS 5 [OS5n U (+=(d U RQ5SS:g$g!,(df  GN=f!,(df  GN =f![*[,4a gf=f![>a gf=f!,(df  GN=f)atChecks the last time we checked for an update and offers one if needed. Offer is made if the time since the last update check is longer than the configured threshold offers the user to update gsutil. Args: command_name: The name of the command being run. debug: Debug level to pass in to boto connection (range 0..3). Returns: True if the user decides to update. )rrrrFrsoftware_update_check_periodrwNr) credentialsrr)zA newer version of gsutil (z1) is available than the version you are running (zp). NOTE: This is a major new version, so it is strongly recommended that you review the release note details at zJ before updating to this version, especially if you use gsutil in scripts.z Would you like to update [y/N]? yz<). A detailed log of gsutil release changes is available at z0 if you would like to read them before updating.z Would you like to update [Y/n]? r))rrrrInvokedViaCloudSdkrrgetintr*GetLastCheckedForGsutilUpdateTimestampFileinttimeospathisfilerRGetGsutilVersionModifiedTimeopenrstrreadliner ValueErrorr%rrHrrVERSIONr&r' Exceptionr!r$r/r0r1rrrlower)rLrXrrzr-last_checked_for_gsutil_update_timestamp_filecur_tslast_checked_tsfricur_vergmanswers r5r1CommandRunner.MaybeCheckForAndOfferSoftwareUpdates6   F >>&&(( #';;#5#50"$6 $q(  <<>2 F 77>>G H H:: ?@ A  # #D9:z5V\\^A.#55 k D CF E $  D CsZ,L+ ML=7MM%(M5+ L:= M M MM"!M"% M21M25 N)rHrJrI) NNrNFFNTNNF)__name__ __module__ __qualname____firstlineno____doc__r rrMrKr`rurrrrrr__static_attributes__rCr5rErEskG)9,D0* 3.?`,%@R ""&*/(-&*"&'+#'(-M^((frCrE)Gr __future__rrrrrrrrPrr0rr+ six.movesrrrboto.storage_urir rRr gslib.cloud_api_delegatorr gslib.commandr rrrrgslib.commandsgslib.cs_api_maprrrgslib.discard_messages_queuergslib.exceptionrgslib.gcs_json_apirgslib.no_op_credentialsrgslib.tab_completer gslib.utilsrrrgslib.utils.constantsrrgslib.utils.metadata_utilr&gslib.utils.parallelism_framework_utilr gslib.utils.text_utilr!r"r#r$gslib.utils.unit_utilr%gslib.utils.update_utilr&r'r6r=rBobjectrErrCr5rs.&%'    - 7!1)'((50=,)3,!!#3&<W138-174%0P6tFtrC