"SrSSKJr SSKJr SSKJr SSKJr SSKrSSKrSSKJ r SSKJ r SS K J r SS K Jr SS K Jr "S S \R 5rSrSrSrSSjrSSSjjrSSSjjrSSjrSrSrSrSrg)z'Hashing utilities for storage commands.)absolute_import) annotations)division)unicode_literalsN)errors)fast_crc32c_util) installers)files)hashingc \rSrSrSrSrSrSrg) HashAlgorithm z&Algorithms available for hashing data.md5crc32cN)__name__ __module__ __qualname____firstlineno____doc__MD5CRC32C__static_attributes__r3lib/googlecloudsdk/command_lib/storage/hash_util.pyr r s. # &rr cH[R"U5RSS9$)z.Takes bytes and returns base64-encoded string.utf-8)encoding)base64 b64encodedecode) hash_bytess rget_base64_stringr#'s!   * % , ,g , >>rcPURS5n[R"U5$)z.Takes base64-encoded string and returns bytes.r)encoder b64decode) hash_stringr"s rget_bytes_from_base64_stringr(,s#!!'**   * %%rc4[UR55$)zATakes hashlib object and returns base64-encoded digest as string.)r#digest) hash_objects rget_base64_hash_digest_stringr,2s ;--/ 00rcU[R:Xa[R"5$U[R:Xa[ R "5$g)z3Returns a hash object for the given hash algorithm.N)r rr get_md5rr get_crc32c)hash_algorithms rget_hash_objectr17s=}((( ?? }+++  & & (( rc[U[R5(a UcSOUnUcSOX4- nURXUS9 U$)z?Returns the hash for the given path and deferred crc32c object.r)offsetlength) isinstancerDeferredCrc32csum_file)pathr+startstopr3r4s r_get_hash_for_deferred_crc32cr;@sI -<<==-QUF,QDMFV< rc[U5nUcg[U[R5(a [ XX45$UR U5 U$)aOReturns the hash object for the given data chunk or file. For MD5 and FastCRC32C, this function will return a hash object after hashing the given data chunk. For DeferredCRC32C, this function will return the deferred hash object from the given file path. Args: path (str): The file path. data (bytes): The data chunk to hash. hash_algorithm (HashAlgorithm): The algorithm to use for hashing. start (int|None): Optional byte index to start hashing from. stop (int|None): Optional byte index to stop hashing at. Returns: A hash object or None if the algorithm is not supported. N)r1r5rr6r;update)r8datar0r9r:r+s r get_hash_from_data_chunk_or_filer?NsL& /+  -<<== (E HH T rc[U5nUcg[U[R5(a [ XX#5$[ R "U5nU(aURU5 U(aUR5U:aOUb%UR5[R-U:a[RnOX5R5- nURU5nU(dO9[U[5(aURS5nURU5 MSSS5 U$!,(df  U$=f)a=Reads file and returns its hash object. core.util.files.Checksum does similar things but is different enough to merit this function. The primary differences are that this function: -Uses a FIPS-safe MD5 object. -Accomodates gcloud_crc32c, which uses a Go binary for hashing. -Supports start and end index to set byte range for hashing. Args: path (str): File to read. hash_algorithm (HashAlgorithm): Algorithm to hash file with. start (int|None): Byte index to start hashing at. stop (int|None): Stop hashing at this byte index. Returns: Hash object for file. Nr)r1r5rr6r;r BinaryFileReaderseektellr WRITE_BUFFER_SIZEreadstrr%r=)r8r0r9r:r+stream bytes_to_readr>s rget_hash_from_filerIjs$ /+  -<<== (E HH d#v  kk%  &++-4'  )E)EEL"44 {{}, [[ 'd  D#  {{7#% $. /$#. s CD.. D=cZX:wa&[R"SRXU55eg)zConfirms hashes match for copied objects. Args: object_path (str): URL of object being validated. source_hash (str): Hash of source object. destination_hash (str): Hash of destination object. Raises: HashMismatchError: Hashes are not equal. z@Source hash {} does not match destination hash {} for object {}.N)rHashMismatchErrorformat) object_path source_hashdestination_hashs rvalidate_object_hashes_matchrPs5$  " "  & L NN%rcTUR5HnURU5 M g)z?Updates every hash object with new data in a dict of digesters.N)valuesr=) digestersr>r+s rupdate_digestersrTs#%%'kt(rcD0nUHnXR5X'M U$)zBReturns copy of provided digesters since deepcopying doesn't work.)copy)rSresultr0s rcopy_digestersrXs* &!n&6;;=F" -rc UH~nU[RLa[R"5X'M/U[RLa[ R "5X'M[[R"SRU55e g)z>Clears the data from every hash object in a dict of digesters.z-Unknown hash algorithm found in digesters: {}N) r rr r.rrr/rErrorrL)rSr0s rreset_digestersr[sg!n***")//"3i =// /"2"="="?i LL 9 @ @ P  "r)r0r )NN)r8rFr+zfast_crc32c_util.DeferredCrc32creturnz int | None)r8rFr>bytesr0r )r __future__rrrrrenum"googlecloudsdk.command_lib.storagerrgooglecloudsdk.core.updaterr googlecloudsdk.core.utilr r Enumr r#r(r,r1r;r?rIrPrTrXr[rrrrds.&"' 5?2*,DII? & 1     0   MQ ,980fN"  r