=lSrSSKJr SSKJr SSKJr SSKrSSKrSSKrSSKrSSK J r SSK J r SSKJr SS KJr SS KJr SS KJr SS KJr SS KJr SSKJr SSKJr SSKrSr"SS\R65r"SS\5r"SS\5r"SS\5r"SS\5r Sr!Sr"Sr#Sr$Sr%S r&S!r'S"r("S#S$\)5r*"S%S&\)5r+S'r,S(r-S)r.SS*\R^R`\R^R`4S+jr1"S,S-\)5r2"S.S/\)5r3"S0S1\Rh5r5g)2z4Utilities for interacting with Google Cloud Storage.)absolute_import)division)unicode_literalsN)apis) gcloudignore)config) exceptions)execution_utils)log) resources)files) iso_duration) platformszgs://c\rSrSrSrSrg)Error+z)Base class for exceptions in this module.N__name__ __module__ __qualname____firstlineno____doc____static_attributes__r2lib/googlecloudsdk/api_lib/storage/storage_util.pyrr+s1rrc\rSrSrSrSrg) GsutilError/z-Exception raised when gsutil cannot be found.rNrrrrrr/s5rrc,^\rSrSrSrU4SjrSrU=r$)InvalidNameError3z.Error indicating that a given name is invalid.c H>[[U] SRXX4S95 g)Nz>Invalid {type} name [{name}]: {reason} See {url} for details.)namereasontypeurl)superr!__init__format)selfr$r% type_namer' __class__s rr)InvalidNameError.__init__6s. D* "#)6t/8$*$CDrr)rrrrrr)r __classcell__r-s@rr!r!3s6DDrr!c4^\rSrSrSrSrSrU4SjrSrU=r $)InvalidBucketNameError=z5Error indicating that a given bucket name is invalid.bucketz9https://cloud.google.com/storage/docs/naming#requirementscX>[[U] XURUR5 gN)r(r2r)TYPEURLr+r$r%r-s rr)InvalidBucketNameError.__init__B" $0 dii+rr rrrrrr7r8r)rr/r0s@rr2r2=s= $C#++rr2c4^\rSrSrSrSrSrU4SjrSrU=r $)InvalidObjectNameErrorGz5Error indicating that a given object name is invalid.objectz8https://cloud.google.com/storage/docs/naming#objectnamescX>[[U] XURUR5 gr6)r(r>r)r7r8r9s rr)InvalidObjectNameError.__init__Lr;rrr<r0s@rr>r>Gs= $B#++rr>zeBucket names must contain only lowercase letters, numbers, dashes (-), underscores (_), and dots (.).z8Bucket names must start and end with a number or letter.zBucket names must contain 3 to 63 characters. Names containing dots can contain up to 222 characters, but each dot-separated component can be no longer than 63 characters.zjBucket names cannot be represented as an IP address in dotted-decimal notation (for example, 192.168.5.4).zmObject names can contain any sequence of valid Unicode characters, of length 1-1024 bytes when UTF-8 encoded.zFObject names must not contain Carriage Return or Line Feed characters.crURS5nS[U5s=::aS::aO O[SU55(a[U[5e[ U5[ [ R[ R-S-5- (a[U[5e[ USUS-5[ [ R[ R-5- (a[U[5e[U5S:Xa5S RU5R5(a[U[5eg g ) aValidate the given bucket name according to the naming requirements. See https://cloud.google.com/storage/docs/naming#requirements Args: name: the name of the bucket, not including 'gs://' Raises: InvalidBucketNameError: if the given bucket name is invalid .c3># UHn[U5S:v M g7f)?N)len).0cs r &_ValidateBucketName..rs'HZA Zsz-_.rN)splitrIanyr2VALID_BUCKET_LENGTH_MESSAGEsetstringascii_lowercasedigitsVALID_BUCKET_CHARS_MESSAGEVALID_BUCKET_START_END_MESSAGEjoinisdigit#VALID_BUCKET_DOTTED_DECIMAL_MESSAGE)r$ componentss r_ValidateBucketNamer^fszz#* s4y C C'HZ'H$H$H 'B CCYV++fmm;eCDD 'A BBa48 s6#9#9FMM#IJJ 'E FF_bggj199;; 'J KK<rcUR[5(aU[[5SnOUn[UR S55 g)N/) startswithGSUTIL_BUCKET_PREFIXrIr^rstrip)r'r$s rValidateBucketUrlrds= ^^()) s'() *D Ddkk#&'rcp\rSrSrSrSr\S5r\S5r\SSj5r Sr Sr S r S r S rS rg )BucketReferencez=A wrapper class to make working with GCS bucket names easier.cXlg)zACreates a BucketReference. Args: bucket: str, The bucket name Nr4)r+r4s rr)BucketReference.__init__s Krc&U"UR5$)z=Create a bucket reference from a bucket message from the API.r$)clsr4s r FromMessageBucketReference.FromMessages v{{ rc^U"[RRUSS9R5$)z=Parse a bucket URL ('gs://' optional) into a BucketReference.zstorage.buckets) collection)r REGISTRYParser4)rmr's rFromUrlBucketReference.FromUrls/ y!!''8I'J rc"U(a0UR[5(d[R"S5e[ U5 URU5$![ a/n[R"[ R"U55eSnAff=f)zEValidates that the argument is a reference to a Cloud Storage bucket.zIMust be a valid Google Cloud Storage bucket of the form [gs://somebucket]N) rarbargparseArgumentTypeErrorrdr2six text_typert)rmvaluerequire_prefixerrs r FromArgumentBucketReference.FromArgumentsze../CDD  & &  ; ;;u  ";  & &s}}S'9 ::;s A B*B  Bc8SRUR5$)Nzgs://{}r*r4r+s rToUrlBucketReference.ToUrls   DKK ((rc8SRUR5$)Nz"https://storage.googleapis.com/{0}rrs r GetPublicUrlBucketReference.GetPublicUrls / 6 6t{{ CCrc4URUR:H$r6rir+others r__eq__BucketReference.__eq__s ;;%,, &&rc.URU5(+$r6rrs r__ne__BucketReference.__ne__{{5! !!rc,[UR5$r6)hashr4rs r__hash__BucketReference.__hash__s  rriN)T)rrrrrr) classmethodrnrtr~rrrrrrrrrrfrfs`E   )D'"rrfc\rSrSrSrSrSrSr\S5r \S5r \ S5r \ S 5r \ S 5r\ SS j5r\ SS j5r\ S 5rSrSrSrSrSrSrg)ObjectReferencezGWrapper class to make working with Cloud Storage bucket/objects easier.z&^gs://(?P[^/]+)/(?P.+)z^gs://(?P[^/]+)/?cXlX lgr6r4r$)r+r4r$s rr)ObjectReference.__init__s KIrcUR$)z:Emulates the object field on the object core/resource ref.rlrs rr@ObjectReference.objects 99rc,[UR5$)z9Gets a bucket reference for the bucket this object is in.)rfr4rs r bucket_refObjectReference.bucket_refs 4;; ''rc<U"URUR5$)z?Create an object reference from an object message from the API.r)rmobjs rrnObjectReference.FromMessages szz388 $$rc[U5 S[URS55s=::aS::dO [U[5eSU;dSU;a[U[ 5eU"X5$)zVALID_OBJECT_LENGTH_MESSAGEVALID_OBJECT_CHARS_MESSAGE)rmr4r$s rFromNameObjectReference.FromNames] DKK() 1T 1 "4)D EE t|tt| "4)C DD v rc:URURU5$)z>Create an object reference from a bucket reference and a name.)rr4)rmrr$s r FromBucketRefObjectReference.FromBucketRefs << ))4 00rc[R"URU[R5nU(a0UR UR S5UR S55$[R"UR U[R5nU(a+U(aU"UR S5S5$[SS5e[S5e)z?Parse an object URL ('gs://' required) into an ObjectReference.r4r@rPz Empty object name is not allowedz"Must be of form gs://bucket/object) rematchGSUTIL_OBJECT_REGEXDOTALLrgroupGSUTIL_BUCKET_REGEXr> ValueError)rmr'allow_empty_objectrs rrtObjectReference.FromUrls HHS,,c299 =E \\%++h/X1F GG HHS,,c299 =E 5;;x("--$R)KLL 9 ::rcURXS9$![[4a/n[R"[ R "U55eSnAff=f)N)r)rtr>rrwrxryrz)rmr'rr}s rr~ObjectReference.FromArgumentsG; [[[ DD "J /;  & &s}}S'9 ::;sA*A  AcHURU5 g![a gf=f)NFT)rtr)rmpaths r IsStorageUrlObjectReference.IsStorageUrls, kk$   s  !!cNSRURUR5$)Nz gs://{}/{}r*r4r$rs rrObjectReference.ToUrls   t{{DII 66rcNSRURUR5$)Nz$https://storage.googleapis.com/{}/{}rrs rrObjectReference.GetPublicUrls 1 8 8dii PPrcDUR5UR5:H$r6)rrs rrObjectReference.__eq__s ::<5;;= ((rc.URU5(+$r6rrs rrObjectReference.__ne__rrc4[UR55$r6)rrrs rrObjectReference.__hash__s  rrN)F)rrrrrrrr)propertyr@rrrnrrrtr~rrrrrrrrrrrrsOA4   ( (%%  11 ; ;;; 7Q)"rrc0[R"SS5$)z:Import and return the appropriate storage messages module.storagev1) core_apisGetMessagesModulerrr GetMessagesr   $ $Y 55rc0[R"SS5$)z1Import and return the appropriate storage client.rr)rGetClientInstancerrr GetClientr%rrc([R"5RnU(dM[R"S5nU(a%[ R "SRUS95 U$[S5e[RRUS5$)z)Determines the path to the gsutil binary.gsutilzUsing gsutil found at [{path}])rz]A path to the storage client `gsutil` could not be found. Please check your SDK installation.) rPaths sdk_bin_path file_utilsFindExecutableOnPathr debugr*rosrrZ)r gsutil_paths r_GetGsutilPathr*st,,, 11(;K ii077[7IJ  E FF lH --rFc[5nU(aSU/OU/nUbXa- n[RR5[RR:Xa[ R "US-/UQ76nO[ R"U/UQ76n[R"SRSRU5S95 [ R"USUUS9$)aIRuns the specified gsutil command and returns the command's exit code. WARNING: This is not compatible with python 3 and should no longer be used. Args: command_name: The gsutil command to run. command_args: List of arguments to pass to the command. run_concurrent: Whether concurrent uploads should be enabled while running the command. out_func: str->None, a function to call with the stdout of the gsutil command. err_func: str->None, a function to call with the stderr of the gsutil command. Returns: The exit code of the call to the gsutil command. z-mz.cmdzRunning command: [{args}]] )argsT)no_exitout_funcerr_func) rrOperatingSystemCurrentWINDOWSr ArgsForCMDToolArgsForExecutableToolr rr*rZExec) command_name command_argsrun_concurrentrr command_pathr gsutil_argss rRunGsutilCommandr9s, !,!/$ l^$D&&(I,E,E,M,MM!001FNNK!77 LtLK)) ( / /SXXk5J / KL   k4'/'/ 11rc\rSrSrSrSrSrg) FileMetadatai_aFileMetadata contains information about a file destined for GCP upload. Attributes: root: str, The root directory for considering file metadata. path: str, The path of this file, relative to the root. size: int, The size of this file, in bytes. cXlX l[RR[RR X55Ulg)zCollect file metadata. Args: root: str, The root directory for considering file metadata. path: str, The path of this file, relative to the root. N)rootrrgetsizerZsize)r+rrs rr)FileMetadata.__init__hs/II T 89DIr)rrrNrrrrrr)rrrrrr_s  :rrc"\rSrSrSrSSjrSrg)SnapshotitaSnapshot is a manifest of the source in a directory. Attributes: src_dir: str, The root of the snapshot source on the local disk. ignore_file: optional str, an override for .gcloudignore. include_gitignore: bool, whether the local .gitignore shouild be included in the ignored files. files: {str: FileMetadata}, A mapping from file path (relative to the snapshot root) to file metadata. dirs: [str], The list of dirs (possibly empty) in the snapshot. uncompressed_size: int, The number of bytes needed to store all of the files in this snapshot, uncompressed. any_files_ignored: bool, whether any files were ignored. NcXl0Ul/UlSUl[R "URSUUS9nSUl[R"[R"UR55GHupVn[RRXPR5nUGHn [RRX5n [RRU 5(aK[RRU 5(d'[ R""SR%U 55 MUS:wa[RRX5OU n UR'U 5(d SUlM[)URU 5n XRU 'U=RU R*- slGM USSHmn US:wa[RRX5OU nUR'USS9(dUR-U 5 MRURR/U5 Mo GM g)NrF) write_on_disk ignore_fileinclude_gitignorez5Ignoring [{}] which is a symlink to non-existent pathrDT)is_dir)src_dirr dirsuncompressed_sizerGetFileChooserForDirany_files_ignoredrwalkryrzrrelpathrZislinkexistsr infor* IsIncludedrrremoveappend)r+rrr file_chooserdirpathdirnames filenamesrfnamerfpathfmdnamedpaths rr)Snapshot.__init__sLDJDID44 + L #D+-''#-- 2M*N&I6g%ww||G+ 77>>$  t(<(< ((ELL  073 W,E&&u--#'$  $,, . 5 "'')$A;%073 W,E&&uT&: //%   )+Or)rrr rr)NTrrrrrrts  ' rrcX\rSrSrSrSrSrSrSrSr Sr \\-r \ \ -r \ \-r S\ -rS rg ) ObjectLockRetentionDurationiavSpecialized object lock duration class derived from iso_duration.Duration. Retention period for object lock feature follows non iso standard values for years and months. A year is considered to be 365.25 days and every month is expected to have 31 days. This class makes the required changes so that calculations are adjusted accordingly when parsing the duration string. gv@i@B< rN)rrrrr_DAYS_PER_YEAR_MICROSECONDS_PER_SECOND_SECONDS_PER_MINUTE_MINUTES_PER_HOUR_HOURS_PER_DAY_MONTHS_PER_YEAR_SECONDS_PER_HOUR_SECONDS_PER_DAY_SECONDS_PER_YEAR_SECONDS_PER_MONTHrrrrrrsY.$.),==&7&7,,rr)6r __future__rrrrwrrrUgooglecloudsdk.api_lib.utilrrgooglecloudsdk.command_lib.utilrgooglecloudsdk.corerr r r r googlecloudsdk.core.utilr rrrryrbrrrr!r2r>rXrYrSr\rrr^rdr@rfrrrrfile_only_loggerrrrrDurationrrrrr/sN ;&' 98&*/#)81. 2J  26%6DzD+-++-+""<@'(# .JLH(2f2jTfTn6 6 . #'$)!2288!2288 #1L:6:*7 v7 t-,"7"7-r