6&SrSSKJr SSKJr SSKJr SSKJr SSKrSSKrSSKJ r SSK J r "S S \5r"S S \5r"S S\5r"SS\5r"SS\5r"SS\5r"SS\5r"SS\5r"SS\5rg)zAThread message classes. Messages are added to the status queue. )absolute_import)print_function)division)unicode_literalsN)Error)errorc(\rSrSrSrSSjrSrSrg) StatusMessage zTGeneral StatusMessage class. All Message classes inherit this StatusMessage class. NcXlU=(d [R"5UlU=(d [R "5R Ulg)zCreates a Message. Args: message_time: Time that this message was created (since Epoch). process_id: Process ID that produced this message (overridable for testing). thread_id: Thread ID that produced this message (overridable for testing). N)timeosgetpid process_id threadingcurrent_threadident thread_id)self message_timerrs 'platform/gsutil/gslib/thread_message.py__init__StatusMessage.__init__&s6I /BIIKDOB)":":"<"B"BDNcURR<SUR<SUR<SUR<S3$);Returns a string with a valid constructor for this message.( , process_id= , thread_id=)) __class____name__r rrrs r__str__StatusMessage.__str__3s/  $))T__dnn NOr)rrr )NN)r" __module__ __qualname____firstlineno____doc__rr$__static_attributes__rrr r s COrr c>^\rSrSrSrSU4SjjrSrSrU=r$)RetryableErrorMessage:zMessage class for retryable errors encountered by the JSON API. This class contains information about the retryable error encountered to report to analytics collection and to display in the UI. cx>[[U] UUUS9 URRUlURR S;a,SURRR5-Ul[U[5(d[U[5(aSUl OSUl X0l X@l g)aCreates a RetryableErrorMessage. Args: exception: The retryable error that was thrown. message_time: Float representing when message was created (seconds since Epoch). num_retries: The number of retries consumed so far. total_wait_sec: The total amount of time waited so far in retrying. process_id: Process ID that produced this message (overridable for testing). thread_id: Thread ID that produced this message (overridable for testing). rr)socket_socketSocketTFN)superr-rr!r" error_typer& capitalize isinstanceapitools_service_errorsix_service_erroris_service_error num_retriestotal_wait_sec)r exceptionrr;r<rrr!s rrRetryableErrorMessage.__init__As& / ;E:C0E ))22DO%%)>> 9#6#6#?#?#J#J#LLdo94559/00"d#d#)rcURR<SUR<SUR<SUR<SUR <SUR <SUR<S3$)rrz(), num_retries=z, total_wait_sec=z, time=rrr )r!r"r5r;r<r rrr#s rr$RetryableErrorMessage.__str__ksF^^ $ $doot7G7G  $))T__dnn NOr)r5r:r;r<)rrNN r"r&r'r(r)rr$r* __classcell__r!s@rr-r-:s( ()TOOrr-c,^\rSrSrSrU4SjrSrU=r$) FinalMessagesz^Creates a FinalMessage. A FinalMessage simply indicates that we have finished our operation. c,>[[U] U5 g)zxCreates a FinalMessage. Args: message_time: Float representing when message was created (seconds since Epoch). N)r4rErrrr!s rrFinalMessage.__init__ys ,&|4rr+r"r&r'r(r)rr*rBrCs@rrErEss 55rrEc,^\rSrSrSrU4SjrSrU=r$)MetadataMessagezCreates a MetadataMessage. A MetadataMessage simply indicates that a metadata operation on a given object has been successfully done. The only passed argument is the time when such operation has finished. c,>[[U] U5 g)z{Creates a MetadataMessage. Args: message_time: Float representing when message was created (seconds since Epoch). N)r4rLrrHs rrMetadataMessage.__init__s /4),7rr+rJrCs@rrLrLs88rrLcp^\rSrSrSrSrSrSrSrSr Sr S r S r S r S rS rSU4SjjrSrSrU=r$) FileMessagezMarks start or end of an operation for a file, cloud object or component. This class contains general information about each file/component. With that, information such as total size and estimated time remaining may be calculated beforehand.  c >[[U] UU U S9 XlX lX@lX`lXPlXplXl g)a>Creates a FileMessage. Args: src_url: FileUrl/CloudUrl representing the source file. dst_url: FileUrl/CloudUrl representing the destination file. message_time: Float representing when message was created (seconds since Epoch). size: Total size of this file/component, in bytes. finished: Boolean to indicate whether this is starting or finishing a file/component transfer. component_num: Component number, if dealing with a component. message_type: Type of the file/component. bytes_already_downloaded: Specific field for resuming downloads. When starting a component download, it tells how many bytes were already downloaded. process_id: Process ID that produced this message (overridable for testing). thread_id: Thread ID that produced this message (overridable for testing). r0N) r4rQrsrc_urldst_urlsize component_numfinished message_typebytes_already_downloaded) rr_r`rrarcrbrdrerrr!s rrFileMessage.__init__sI> +t%l1;09&;LLI&M$$<!rcNURR<SUR<SUR<SUR<SUR <SUR <SUR<SUR<SUR<S UR<S UR<S 3$) rz('z', '', z, size= , finished=, component_num=z, message_type=z, bytes_already_downloaded=rrr ) r!r"r_r`r rarcrbrdrerrr#s rr$FileMessage.__str__sa ^^ $ $dllDLL$)) YY t'9'94;L;L  * *DOOT^^  MNr)rerbr`rcrdrar_)NFNNNNN)r"r&r'r(r) FILE_DOWNLOAD FILE_UPLOADFILE_CLOUD_COPYFILE_LOCAL_COPYFILE_DAISY_COPY FILE_REWRITE FILE_HASHCOMPONENT_TO_UPLOADEXISTING_COMPONENTCOMPONENT_TO_DOWNLOADEXISTING_OBJECT_TO_DELETErr$r*rBrCs@rrQrQsp-+///,)   ! (,(=TNNrrQc@^\rSrSrSrSU4SjjrSrSrU=r$)ProgressMessagezMessage class for a file/object/component progress. This class contains specific information about the current progress of a file, cloud object or single component. c >[[U] U5 XlX lX`lX0lXPlX:HUlXpl g)a!Creates a ProgressMessage. Args: size: Integer for total size of this file/component, in bytes. processed_bytes: Integer for number of bytes already processed from that specific component, which means processed_bytes <= size. src_url: FileUrl/CloudUrl representing the source file. message_time: Float representing when message was created (seconds since Epoch). dst_url: FileUrl/CloudUrl representing the destination file, or None for unary operations like hashing. component_num: Indicates the component number, if any. operation_name: Name of the operation that is being made over that component. process_id: Process ID that produced this message (overridable for testing). thread_id: Thread ID that produced this message (overridable for testing). N) r4rxrraprocessed_bytesrbr_r`rcoperation_name) rrar{r_rr`rbr|rrr!s rrProgressMessage.__init__s?8 /4),7I*&LL,DM(rcUR(aSUR-OSnUR(aSUR-OSnURR<SUR<SUR <SUR <SUR<SU<SUR<S U<S UR<S UR<S 3$) rz'%s'Nr, z, 'rhz , dst_url=rjz, operation_name=rrr ) r`r|r!r"rar{r_r rbrr)rdst_url_stringoperation_name_strings rr$ProgressMessage.__str__s37,,h-DN+/+>+>4&&&D^^ $ $dii1E1E \\499nd6H6H "DOOT^^  EFr)rbr`rcr|r{rar_)NNNNNrArCs@rrxrxs+!"#)J F Frrxc2^\rSrSrSrU4SjrSrSrU=r$)SeekAheadMessageia Message class for results obtained by SeekAheadThread(). It estimates the number of objects and total size in case the task_queue cannot hold all tasks at once (only used in large operations). This class contains information about all the objects yet to be processed. cD>[[U] U5 XlX lg)a-Creates a SeekAheadMessage. Args: num_objects: Number of total objects that the SeekAheadThread estimates. size: Total size corresponding to the sum of the size of objects iterated by SeekAheadThread. message_time: Float representing when message was created (seconds since Epoch). N)r4rr num_objectsra)rrrarr!s rrSeekAheadMessage.__init__$s  D*<8"Irc URR<SUR<SUR<SUR<SUR <SUR <S3 $)rrrrrr )r!r"rrar rrr#s rr$SeekAheadMessage.__str__2s<^^ $ $d&6&6 499 __dnn ./r)rrarArCs@rrrs //rrc6^\rSrSrSrSU4SjjrSrSrU=r$)ProducerThreadMessagei9aMessage class for results obtained by calculations made on ProducerThread. It estimates the number of objects and total size currently dealty by task_queue. If the task_queue cannot support all objects at once, the SeekAheadThread will be responsible for sending an accurate message. cP>[[U] U5 XlX lX@lg)a2Creates a SeekAheadMessage. Args: num_objects: Number of total objects that the task_queue has. size: Total size corresponding to the sum of the size of objects iterated by the task_queue message_time: Float representing when message was created (seconds since Epoch). finished: Boolean to indicate whether this is the final message from the ProducerThread. The difference is that this message displays the correct total size and number of objects, whereas the previous ones were periodic (on the number of files) updates. N)r4rrrrarc)rrrarrcr!s rrProducerThreadMessage.__init__As% / ="IMrc URR<SUR<SUR<SUR<SUR <S3 $)rrrrir )r!r"rrar rcr#s rr$ProducerThreadMessage.__str__Ts6^^ $ $d&6&6 499 ]] r)rcrra)FrArCs@rrr9s&rrc2^\rSrSrSrU4SjrSrSrU=r$)PerformanceSummaryMessagei[zMessage class to log PerformanceSummary parameters. This class acts as a relay between a multiprocess/multithread situation and the global status queue, from which the PerformanceSummary info gets consumed. c8>[[U] USSS9 X lg)zCreates a PerformanceSummaryMessage. Args: message_time: Float representing when message was created (seconds since Epoch). uses_slice: True if the command uses slice parallelism. Nr0)r4rr uses_slice)rrrr!s rr"PerformanceSummaryMessage.__init__bs* #T3L?C>B4D!OrcnURR<SUR<SUR<S3$)rrrr )r!r"r rr#s rr$!PerformanceSummaryMessage.__str__os)^^ $ $dii BCr)rrArCs@rrr[s !CCrr)r) __future__rrrrrrapitools.base.py.exceptionsrr8six.moves.http_clientrr9objectr r-rErLrQrxrrrr+rrrs '%' G<OFO46OM6Or 5= 5 8m8$KN-KN\6Fm6Fr/}/:MDC Cr