0SrSSKJr SSKJr SSKJr SSKJr SSKJr SSKrSSK r SSK r SSK r SSK r SSK Jr SS KJrJr SS KJr \"S S 5r"S S\5rSrSrSrSSjrSSjrSSjrg)zAHelper functions for composite upload tracker file functionality.)absolute_import)print_function)division)unicode_literals) namedtupleN)CommandException)WriteJsonDataToTrackerFile#RaiseUnwritableTrackerFileException)UTF8ObjectFromTrackerzobject_name generationc,\rSrSrSrSrSrSrSrSr Sr g ) _CompositeUploadTrackerEntry&z7Enum class for composite upload tracker file JSON keys. componentscomponent_namecomponent_generationencryption_key_sha256prefixN) __name__ __module__ __qualname____firstlineno____doc__COMPONENTS_LISTCOMPONENT_NAMECOMPONENT_GENERATION ENC_SHA256PREFIX__static_attributes__r.platform/gsutil/gslib/parallel_tracker_file.pyrr&s? /#./&* &r!rcSnSn/nSn[US5nUR5n[R"U5nU[R nU[R nU[RH@nUR[U[RU[R55 MB U(aUR)5 X#U4$![aEn U R[R:waURSUU R 5 Sn A NeSn A f["[$4an Sn['W5up4Sn A NSn A ff=f!U(aUR)5 ff=f)azRead the tracker file from the last parallel composite upload attempt. If it exists, the tracker file is of the format described in WriteParallelUploadTrackerFile or a legacy format. If the file doesn't exist or is formatted incorrectly, then the upload will start from the beginning. This function is not thread-safe and must be protected by a lock if called within Command.Apply. Args: tracker_file_name: The name of the tracker file to read parse. logger: logging.Logger for outputting log messages. Returns: enc_key_sha256: Encryption key SHA256 used to encrypt the existing components, or None if an encryption key was not used. component_prefix: String prefix used in naming the existing components, or None if no prefix was found. existing_components: A list of ObjectFromTracker objects representing the set of files that have already been uploaded. Nrz^Couldn't read upload tracker file (%s): %s. Restarting parallel composite upload from scratch.)openreadjsonloadsrrrrappendr rrIOErrorerrnoENOENTwarnstrerrorKeyError ValueError_ParseLegacyTrackerDataclose) tracker_file_nameloggerenc_key_sha256rexisting_components tracker_file tracker_data tracker_json componentes r"ReadParallelUploadTrackerFiler</sQ,. &,)3/L$$&L::l+L!">"I"IJN 6== >F!">"N"NO   4CCD4IIJ LMP& "5 66#  ww%,, kk 45F ** J JN$;L$I!V J s<B/C E ;DE E 1EE E  E E'cURS5SSnSn/nU(a_USnSnU[U5S- :aFXXS-peU(dSnUR[XV55 US- nU[U5S- :aMFX#4$)adParses a legacy parallel composite upload tracker file. Args: tracker_data: Legacy tracker file contents. Returns: component_prefix: The prefix used in naming the existing components, or None if no prefix was found. existing_components: A list of ObjectFromTracker objects representing the set of files that have already been uploaded.  Nr)splitlenr)r )r8old_tracker_datarr6iname generations r"r1r1ks"''-cr2 & a F A c"#a' ',/1Aa%1HZ    !24!DE1fa c"#a' '  &&r!c [R(aT[U[5(aUR [ 5n[U[5(aUR [ 5nU(aX:waUR SU5 /n UH5n UR5n U RU lU RU l M7 URUU U [RRURRS9 S/4$X#4$! UV s/sHoRPM Os sn fn n UR SSR!U 55 S/4$=f)aValidates that tracker data matches the current encryption key. If the data does not match, makes a best-effort attempt to delete existing temporary component objects encrypted with the old key. Args: tracker_file_name: String file name of tracker file. existing_enc_sha256: Encryption key SHA256 used to encrypt the existing components, or None if an encryption key was not used. existing_prefix: String prefix used in naming the existing components, or None if no prefix was found. existing_components: A list of ObjectFromTracker objects representing the set of files that have already been uploaded. current_enc_key_sha256: Current Encryption key SHA256 that should be used to encrypt objects. bucket_url: Bucket URL in which the components exist. command_obj: Command class for calls to Apply. logger: logging.Logger for outputting log messages. delete_func: command.Apply-callable function for deleting objects. delete_exc_handler: Exception handler for delete_func. Returns: prefix: existing_prefix, or None if the encryption key did not match. existing_components: existing_components, or empty list if the encryption key did not match. zUpload tracker file (%s) does not match current encryption key. Deleting old components and restarting upload from scratch with a new tracker file that uses the current encryption key.) arg_checkerparallel_operations_overridezrFailed to delete some of the following temporary objects: %s (Continuing on to re-upload components from scratch.)r>N)sixPY3 isinstancestrencoder r-Clone object_namerGApplygslibcommandDummyArgCheckerParallelOverrideReasonSPEEDjoin)r3existing_enc_sha256existing_prefixr6current_enc_key_sha256 bucket_url command_objr4 delete_funcdelete_exc_handlercomponents_to_deleter:urlcomponent_namess r"$ValidateParallelCompositeTrackerDatarcsP> WW%s++/66t<(#..5<r}sH&%'" ,E&24LM697x'>F0R P&EI PJ:>,Cr!