l jSrSSKJr SSKJr SSKJr SSKJr SSKrSSKrSSKrSSK r SSK r SSK J r SSK Jr SS KJr SS KJr SS KJr SS KJr SS KJr "SS\R.5r"SS\R.5r\ R4"S5r\"/SQ5r\\"/SQ5-r\"/SQ5r\"/SQ5r \"/SQ5r!SSSSSS.SSS S!S"S#S$S%S&S'S(. S)S*S+S,S-S.S/S0.S1S2S3S4S5.S6.r"\"S7S8/5r#SGS9jr$S:r%S;r&"S<S=\'5r("S>S?\'5r)S@r*SAr+SBr,SCr-SDr."SESF\'5r/g)HzCHelper for shim used to translate gsutil command to gcloud storage.)absolute_import)print_function)division)unicode_literalsN)config) exception) ApiSelector)CommandException) boto_util) constants) system_utilc \rSrSrSrSrSrSrg)HIDDEN_SHIM_MODE% no_fallbackdry_runnoneN)__name__ __module__ __qualname____firstlineno__ NO_FALLBACKDRY_RUNNONE__static_attributes__r(platform/gsutil/gslib/utils/shim_util.pyrr%s+ ' $rrc\rSrSrSrSrSrg)RepeatFlagType+rrN)rrrrLISTDICTrrrrr r +s $ $rr z(^decryption_key([1-9]$|[1-9][0-9]$|100$))cpmvrsyncsetmeta)lsrewritestatcatcompose)r-r*rm retention)z cache-controlzcontent-dispositionzcontent-encoding content-md5zcontent-languagez content-typez custom-time)zx-goog-generation-matchzx-goog-if-generation-matchzx-goog-metageneration-matchzx-goog-if-metageneration-matchAWS_ACCESS_KEY_IDAWS_SECRET_ACCESS_KEY%CLOUDSDK_STORAGE_GS_XML_ACCESS_KEY_ID)CLOUDSDK_STORAGE_GS_XML_SECRET_ACCESS_KEY-CLOUDSDK_CONTEXT_AWARE_USE_CLIENT_CERTIFICATE)aws_access_key_idaws_secret_access_keygs_access_key_idgs_secret_access_keyuse_client_certificateCLOUDSDK_PROXY_ADDRESSCLOUDSDK_PROXY_TYPECLOUDSDK_PROXY_PORTCLOUDSDK_PROXY_USERNAMECLOUDSDK_PROXY_PASSWORDCLOUDSDK_PROXY_RDNSCLOUDSDK_CORE_HTTP_TIMEOUT"CLOUDSDK_CORE_CUSTOM_CA_CERTS_FILE!CLOUDSDK_STORAGE_BASE_RETRY_DELAYCLOUDSDK_STORAGE_MAX_RETRIES) proxy proxy_type proxy_port proxy_user proxy_pass proxy_rdnshttp_socket_timeoutca_certificates_filemax_retry_delay num_retriesCLOUDSDK_STORAGE_CHECK_HASHESCLOUDSDK_CORE_PROJECT%CLOUDSDK_CORE_DISABLE_USAGE_REPORTINGCLOUDSDK_STORAGE_USE_MAGICFILE4CLOUDSDK_STORAGE_PARALLEL_COMPOSITE_UPLOAD_THRESHOLD$CLOUDSDK_STORAGE_RESUMABLE_THRESHOLD&CLOUDSDK_STORAGE_RSYNC_LIST_CHUNK_SIZE) check_hashesdefault_project_iddisable_analytics_prompt use_magicfile#parallel_composite_upload_thresholdresumable_thresholdrsync_buffer_linesCLOUDSDK_AUTH_CLIENT_IDCLOUDSDK_AUTH_CLIENT_SECRETCLOUDSDK_AUTH_AUTH_HOSTCLOUDSDK_AUTH_TOKEN_HOST) client_id client_secretprovider_authorization_uriprovider_token_uri) CredentialsBotoGSUtilOAuth2stet_binary_pathstet_config_pathcUR5nU[;a-U[S5SnURS5(dSU-nOUnOU[;aUnOSnUb.U(aU[;dUS:XagSU-$SR XQ5$SHInURU5(dMU[U5SnU(aSU-s $S R UU5s $ g) aReturns the gcloud storage flag for the given gsutil header. Args: raw_header_key: The header key. header_value: The header value unset: If True, the equivalent clear/remove flag is returned instead of the setter flag. This only applies to setmeta. Returns: A string representing the equivalent gcloud storage flag and value, if translation is possible, else returns None. Examples: >> get_flag_from_header('Cache-Control', 'val') --cache-control=val >> get_flag_from_header('x-goog-meta-foo', 'val') --update-custom-metadata=foo=val >> get_flag_from_header('x-goog-meta-foo', 'val', unset=True) --remove-custom-metadata=foo zx-goog-Nzif-r0z--clear-z--{}={})z x-goog-meta-z x-amz-meta-z--remove-custom-metadata=z--update-custom-metadata={}={})lowerPRECONDITIONS_HEADERSlen startswithDATA_TRANSFER_HEADERSformat)raw_header_key header_valueunsetlowercase_header_keyproviderless_flag flag_name header_prefix metadata_keys rget_flag_from_headerrzs0(--/22&s9~7  ' ' . .++i#i44$II !6 6:NR_:_I%%   I 446m&&}55#C $6$78l *\99/66|7CE E7 rc0[R(agg)Nz^^^^^r IS_WINDOWSrrrget_format_flag_caretrs  rc0[R(agg)Nz^\^n r}rrrget_format_flag_newliners  rc"\rSrSrSSjrSrg)GcloudStorageFlagNc(XlX lX0lg)aInitializes GcloudStorageFlag. Args: gcloud_flag (str|dict): The name of the gcloud flag or a dictionary for when the gcloud flag depends on a gsutil value. gsutil "--pap off" -> gcloud "--no-public-access-prevention" repeat_type (RepeatFlagType|None): Gsutil sometimes handles list and dictionary inputs by accepting a flag multiple times. support_output_translation (bool): If True, this flag in gcloud storage supports printing gsutil formatted output. N gcloud_flag repeat_typesupports_output_translation)selfrrrs r__init__GcloudStorageFlag.__init__s#"'B$rrNF)rrrrrrrrrrrs +0Crrc$\rSrSrSrSSjrSrg)GcloudStorageMapzEMapping to translate gsutil command to its gcloud storage equivalent.c(XlX lX0lg)a Intalizes GcloudStorageMap. Args: gcloud_command (dict|str): The corresponding name of the command to be called in gcloud. If this command supports sub-commands, then this field must be a dict of sub-command-name:GcloudStorageMap pairs. flag_map (dict): A dict of str to GcloudStorageFlag. Mapping of gsutil flags to their equivalent gcloud storage flag names. supports_output_translation (bool): Indicates if the corresponding gcloud storage command supports the printing gsutil formatted output. N)gcloud_commandflag_mapr)rrrrs rrGcloudStorageMap.__init__s)M'B$r)rrrNF)rrrr__doc__rrrrrrrsM ,1Crrcz[RRUS[R(aS5$S5$)Nbinz gcloud.cmdgcloud)ospathjoinr r~) cloudsdk_roots r_get_gcloud_binary_pathrs7 mU&1&<&:,::m^> rcUR"SS5nU(a2UR"SS5nU(aSU-OSnSRX5$g)Nres3_hosts3_portrrz https://{}{}r)rrrrs r!_get_s3_endpoint_from_boto_configrsF JJ}i 0' jj 2G#3=D   // rc /n[R"[5nSnU[U5:Ga3XUR;aUR X5 US- nM<URXnU(dUS- nOUR (aX5R XS-5 US- nO[UR[5(a!UR UR5 US- nOhXS-UR;a"[SRXXS-55eURXS-nU(aUR U5 US- nU[U5:aGM3UR5HupWUR [RLaSRU5nOUR [R La@SRUV s/sH"n SR"U R#SS56PM$ sn 5nO$[SRUR 55eUR SRURU55 M U$s sn f) Nrr"z.Flag value not in translation map for "{}": {},{}={}rz'Shim cannot handle repeat flag type: {}) collections defaultdictlistrnrappendr isinstancerstr ValueErrorrqitemsr r#rr$split) argsgcloud_storage_map gcloud_argsrepeat_flag_dataigcloud_flag_objecttranslated_flag_and_valuevaluescondensed_flag_valuesss r_convert_args_to_gcloud_valuesr$s.+ ,,T2! CI  w(111!1fa+44TW= 1fa  ' '*11$1u+>1fa &22C 8 8+7781fa !e.:: : < C C!e &' '#5"@"@!e"M "451fa= CI @%5$:$:$< %%)<)<<!hhv.  ' '>+>+> >!hh5; >1773? +V <> @GG  & &( ))w~~&8&D&D&;=>%=  =s)I cr\rSrSrSrSrSrSrSrSr SSjr S r SS jr SS jr S rS rSrSrSrg)GcloudStorageCommandMixiniYzProvides gcloud storage translation functionality. The command.Command class must inherit this class in order to support converting the gsutil command to it's gcloud storage equivalent. Nc.SUlSUlSUlgN)"_translated_gcloud_storage_command_translated_env_variables_gcloud_has_active_account)rs rr"GcloudStorageCommandMixin.__init__bs.2D+%)D"&*D#rc[5nURc[R"USSS/[R[RSS9nUR (a/[ R"SRUR55eURR5S:gUlURRSRURUR55 UR$) z8Returns True if gcloud has an active account configured.rraccountzutf-8)stdoutstderrencodingzJError occurred while trying to retrieve gcloud's active account. Error: {}rzHResult for "gcloud config get account" command: STDOUT: {}. STDERR: {})rr subprocessrunPIPE returncoderrrqrrstriploggerdebug)r gcloud_pathprocesss rgcloud_has_active_account3GcloudStorageCommandMixin.gcloud_has_active_accountgs35K &&. XuiH&0oo&0oo(/1g   55 /1 1 )0(<(<(>"(Dd% kk44:F#NNGNN5<=  * **rcVUc/[R"SRUR55e/n[ UR [ 5(aURUR 5 O[ UR [5(azUR(a$[SRUR55eUSnURUSSSS9upURXUR RU55$[SRUR55eU(aiUHcupxXsR;a%[R"SRU55eURU5 US :wdMRURU5 Me [XB-U5$) Nz_Command "{}" cannot be translated to gcloud storage because the translation mapping is missing.zcFlags mapping should not be present at the top-level command if a sub-command is used. Command: {}.rr"F)rshould_update_sub_opts_and_argsz(Incorrect mapping found for "{}" commandz:Command option "{}" cannot be translated to gcloud storager)rrrq command_namerrrextenddictrr ParseSubOpts_get_gcloud_storage_argsrrr) rsub_opts gsutil_argsrr sub_command parsed_argsoptionvalues rr2GcloudStorageCommandMixin._get_gcloud_storage_args{s!  3 3 --3VD4E4E-F HH D$33T:: kk$334 &55t < <  $ $ 228&9J9J2KM M Nk"//120Gh  * *   + + / / <>> AHH    #-& 44 477 &v0 0 ++f  b[ KK $ *$*<*< >>rc/nSSS.nURS:aURSS/5 URS:XaURS5 UR(aURS 5 UR(aURS UR-5 UR (aURS UR -5 [ R(a"URS [ R-5 URS :H=(a@ [R"SS5S:H=(a [R"SS5S:H(+nUR(dU(d SUS'SUS'X4$)aTranslates gsutil's top level flags. Gsutil specifies the headers (-h) and boto config (-o) as top level flags as well, but we handle those separately. Returns: A tuple. The first item is a list of top level flags that can be appended to the gcloud storage command. The second item is a dict of environment variables that can be set for the gcloud storage command execution. gsutil_shimTrue)CLOUDSDK_METRICS_ENVIRONMENT#CLOUDSDK_STORAGE_RUN_BY_GSUTIL_SHIMz --verbosityrz --log-httpz--no-user-output-enabledz--billing-project=z--trace-token=z--impersonate-service-account=r'rgparallel_process_count1thread_process_countCLOUDSDK_STORAGE_THREAD_COUNTCLOUDSDK_STORAGE_PROCESS_COUNT) rrr quiet_mode user_project trace_tokenr IMPERSONATE_SERVICE_ACCOUNTrrrparallel_operations)rtop_level_flags env_variablesshould_use_rsync_overrides r_translate_top_level_flags4GcloudStorageCommandMixin._translate_top_level_flagssMO(5/5M zzQmW56 zzQ\* 78 1D4E4EEF -0@0@@A,,=&BBCD!% 1 1W <!= 856#= < 834;B=  $ $(A7:m348;m45  ))rcZ/nUbUO URn/nUR5HupgUR5nUS:XaM[XgUS9n UR[ ;aU (aUR U 5 O/UR[;aU[;aUR U 5 U (aMURRSRUU55 UR SRXg55 M U(a#UR SSRU5-5 U$)aKTranslates gsutil headers to equivalent gcloud storage flags. Args: headers (dict|None): If absent, extracts headers from command instance. unset (bool): Yield metadata clear flags instead of setter flags. Returns: List[str]: Translated flags for gcloud. Raises: GcloudStorageTranslationError: Could not translate flag. zx-goog-api-version)rtzzHeader {}:{} cannot be translated to a gcloud storage equivalent flag. It is being treated as an arbitrary request header.rz--additional-headers=r) headersrrlrzrCOMMANDS_SUPPORTING_ALL_HEADERSr$PRECONDITONS_ONLY_SUPPORTED_COMMANDSrmrwarnrqr) rr rtflagsheaders_to_translateadditional_headersrrrsruflags r_translate_headers,GcloudStorageCommandMixin._translate_headerss  E&-&97t||(<(B(B(D$+113 !5 5 !.e Ld  = =  ,,t    !E E $9 9 T T ,,2F>3?-A B !!'.."NO#)E$ ll*SXX6H-IIJ Lrc/n0n[[5nU(aX2S'[[5nU(aXBS'/n[R"5GHupgUR5GHnupUS:Xa*UR[ ;aUR SU -5 M6[RU5(a'UR[ ;aUR U 5 MwUS:Xa*UR[;aUR SU -5 MU[;a,URRSRXh55 MUS:XaU (dS US 'MUS ;aG[R"5(d-URR!S RXh55 GM>["R%U05R%US 5n U cGMjXU 'GMq GM U(a#UR SSR'U5-5 X4$)zTranslates boto config options to gcloud storage properties. Returns: A tuple where first element is a list of flags and the second element is a dict representing the env variables that can be set to set the gcloud storage properties. 'CLOUDSDK_API_ENDPOINT_OVERRIDES_STORAGE CLOUDSDK_STORAGE_S3_ENDPOINT_URLencryption_keyz--encryption-key=content_languagez--content-language=zNThe boto config field {}:{} cannot be translated to gcloud storage equivalent.https_validate_certificatesT$CLOUDSDK_AUTH_DISABLE_SSL_VALIDATION)r8r9zxThe boto config field {}:{} skipped translation to the gcloud storage equivalent as it would have been unused in gsutil.Nz--decryption-keys=r)rrrrrENCRYPTION_SUPPORTED_COMMANDSrDECRYPTION_KEY_REGEXmatchr '_REQUIRED_BOTO_CONFIG_NOT_YET_SUPPORTEDrerrorrqr UsingGsHmacr_BOTO_CONFIG_MAPrr) rrenv_varsgcs_json_endpoint s3_endpointdecryption_keys section_namesectionkeyrenv_vars r_translate_boto_config0GcloudStorageCommandMixin._translate_boto_configs EH?G > ,,*U2 3#((--#@@   '''#BB ,,,u4 5 ; ; ++  ==CV ,>3 41 1%=A(9 :AA'')) ++  ;;A6 ,<3 4 %((r:>>sDI'  %W 9("0< ll'#((?*CCD ?rcvURURURU=(d UR5$)aTranslates the gsutil command flags to gcloud storage flags. It uses the command_spec.gcloud_storage_map field that provides the translation mapping for all the flags. Args: gcloud_storage_map (GcloudStorageMap|None): Command surface may pass a custom translation map instead of using the default class constant. Useful for when translations change based on conditional logic. Returns: A list of all the options and arguments that can be used with the equivalent gcloud storage command. Raises: GcloudStorageTranslationError: If a flag or command cannot be translated. ValueError: If there is any issue with the mapping provided by GcloudStorageMap. )rrrr)rrs rget_gcloud_storage_args1GcloudStorageCommandMixin.get_gcloud_storage_args*s4(  ( ( tyy"4"O8O8O QQrcU(aURROURRnU"SRSR U555 U(a+U"S5 UR 5HupVU"SXV5 M gg)NzGcloud Storage Command: {} z)Environment variables for Gcloud Storage:z%s=%s)rinforrqrr)rrrr logger_funckvs r"_print_gcloud_storage_command_info%%'$!GQ"(rcUR5up#UR5nUR5upVURU5 [ 5nU/U-U-U-U-nX84$r)rrr+updater) rrrr header_flagsflags_from_botoenv_vars_from_botorgcloud_storage_commands r._get_full_gcloud_storage_execution_informationHGcloudStorageCommandMixin._get_full_gcloud_storage_execution_informationLsv%)%D%D%F"O**,L*.*E*E*G'O+,:<12T9OK*+-<=  00rc URS:XdURS:Xag[R"SSS5n[[R"SSS55nU(Ga8URUR55upEUR5(dS US 'U[R:XaURUUS S 9 g[ R"R S5(d-[ R$"SR['555e[(R*"5(aL[,R.UR0R2;a$[SRUR55eURUU5 XPlX@lg g![ aY [ R"SRS R[Vs/sHo3RPM Os snfsn555ef=f![ R$aPnU[R8:Xa[ R"U5eUR:R=SU5 SnAgSnAff=f)a@Translates the gsutil command to gcloud storage equivalent. The translated commands get stored at self._translated_gcloud_storage_command. This command also translate the boto config, which gets stored as a dict at self._translated_env_variables Returns: True if the command was successfully translated, else False. versiontestFrguse_gcloud_storagehidden_shim_moderzYInvalid option specified for GSUtil:hidden_shim_mode config setting. Should be one of: {}z | r!CLOUDSDK_AUTH_DISABLE_CREDENTIALST)r(CLOUDSDK_CORE_PASS_CREDENTIALS_TO_GSUTILzRequested to use "gcloud storage" but gsutil is not using the same credentials as gcloud. You can make gsutil use the same credentials by running: {} config set pass_credentials_to_gsutil TruezRequested to use "gcloud storage" with Cloud Storage XML API HMAC credentials but the "{}" command can only be used with the Cloud Storage JSON API.zYCannot translate gsutil command to gcloud storage. Going to run gsutil command. Error: %sN)rrgetboolrrrrr rqrrr>r.rrr6rrrrr r!r XML command_specgs_api_supportrrrrr )rrCrDxrr=es r(translate_to_gcloud_storage_if_requestedBGcloudStorageCommandMixin.translate_to_gcloud_storage_if_requestedYs; I%):):f)D 2FNC) **X16 :<%:040c0c  ( ( *1,- --//?E-; < /77 7  1 12H2?:> 2 @> 9 JKK77>?Ef35?7 8 8 ##%%ooT%6%6%E%EE 228&9J9J2KM M  1 12H2? A4J 1+8 ( Y C  & & J &.>?.>WW.>?@ A CCCF 4 4: /;; ;**1- -  678 : : :s8!F%A HCH8HG+*HI'AI""I'cx[RR5nURUR5 U$r)rrcopyr9r)rsubprocess_envss r'_get_shim_command_environment_variablesAGcloudStorageCommandMixin._get_shim_command_environment_variabless,jjoo'O499: rct[R"URUR5S9nUR$)N)env)rrrrRr)rrs rrun_gcloud_storage,GcloudStorageCommandMixin.run_gcloud_storages1nnTDD!%!M!M!OQG   r)rrrrrr)rrrrrrrrrrrr+r.r6r>rMrRrVrrrrrrYsW + +()>V%*N%N4lQ427 # 1BH rrr)0r __future__rrrrrenumrrerbotorgslibrgslib.cs_api_mapr gslib.exceptionr gslib.utilsr r r Enumrr compiler frozensetr rr rprmr"rrzrrobjectrrrrrrrrrrrrdsJ&%' (,!!#tyy  TYY zz"MN#,,L"M ?)/C1!1'0-(/$!#"# # 3 7 ; *++//+; D>5  , # 3 , B 2 4"/6&?8 S/b+4+,+.' 7t  CC,CvC.L 0*2jLLr