SrSSKJr SSKJr SSKJr SSKrSSKJr SSKJ r SSK J r SS K J r SS K Jr SS K Jr S r"S S\R"5r\R&R(S\R&R*S\R&R,S\R&R.S\R&R0S\R&R2S0rSrSSjrSrSr\\SSSS4SjrSr Sr!"SS5r"g)z3Used to collect anonymous transfer-related metrics.)absolute_import)division)unicode_literalsN) storage_url) task_util)metrics) properties)files) platformsc~[RRRR 5(a[RR R R5RSS5n[RR[RR R US5 gg)a;Transform the user agent when the gsutil shim is used to run gcloud. This transforms `gcloud.storage.command` to `gcloud.gsutil.command`. This needs to be called by every command, so the best place to put this is likely surface/storage/__init__.py, but if there's a better place it could be called there instead. zgcloud.storage.zgcloud.gslibshim.N) r VALUESstoragerun_by_gsutil_shimGetBoolr command_nameGetreplaceSetInvocationValue)command_path_strings 6lib/googlecloudsdk/command_lib/storage/metrics_util.pyfix_user_agent_for_gsutil_shimrs1199;;$++33@@DDFNN.0((!!..0CTK<c\rSrSrSrSrSrg)ParallelismStrategy/N)__name__ __module__ __qualname____firstlineno__ SEQUENTIALPARALLEL__static_attributes__rrrrr/s * (rrrrc[RRRR 5n[R "USU-U5 g)zCommon code for processing an event. Args: metric (str): The metric being recorded. value (mixed): The value being recorded. zStorage-N)r r rrrCustomKeyValue)metricvaluers r_record_storage_eventr.As;""**77;;=, zF':EBrc[R"5(a[RR$[R R$N)rshould_use_parallelismrr$r-r#rrr_get_parallelism_strategyr2Ls5%%''  ' ' - --  ' ' - --rcx[RRRR 5(aS$S$)Nrr)r r rrrrrr_get_run_by_gsutil_shimr4Rs-''::BBDDK!Krc[S[55 [S[55 [SU5 [SU5 [SU5 [SU5 [SU5 [SU5 g ) aReports metrics for a transfer. Args: source_scheme (int): The source scheme, i.e. 'gs' or 's3'. destination_scheme (int): The destination scheme i.e. 'gs' or 's3'. num_files (int): The number of files transferred. size (int): The size of the files transferred, in bytes. avg_speed (int): The average throughput of a transfer in bytes/sec. disk_io_time (int): The time spent on disk of a transfer in ms. rRunByGsutilShim SourceSchemeDestinationScheme NumberOfFilesSizeOfFilesBytesAverageSpeedBytesPerSec DiskIoTimeMsN)r.r2r4 source_schemedestination_scheme num_filessize avg_speed disk_io_times rreportrDVsb-/H/JK)+B+DE 6+-?@3*D119= 5rcZ/n[R"S5nUR5SSnUHBnUR5u pEUSR 5(dM1UR U5 MD SSS5 U$!,(df  U$=f![R a U$f=f)zYRetrieves a list of disk partitions. Returns: An array of partition names as strings. z/proc/partitionsrN)r FileReader readlinessplitisdigitappendError) partitionsflinesline_names r_get_partitionsrSls *    , -kkmABe$ 1a 8       D ! .  . -     s5BAB!B6B B BBB*)B*c Sn[5n0n[R"S5nUR5nUHunUR 5SSnUu pxppppX;dM&[ U 5U-n [ U 5U-n [ U 5n [ U 5n [ U 5n [ U5nXXX4X('Mw SSS5 U$!,(df  U$=f![R a U$f=f)aRetrieves disk I/O statistics for all disks. Adapted from the psutil module's psutil._pslinux.disk_io_counters: http://code.google.com/p/psutil/source/browse/trunk/psutil/_pslinux.py Originally distributed under under a BSD license. Original Copyright (c) 2009, Jay Loden, Dave Daeschler, Giampaolo Rodola. Returns: A dictionary containing disk names mapped to the disk counters from /disk/diskstats. iz/proc/diskstatsN )rSr rGrHrIintrL) sector_sizerMretdictrNrOrPvaluesrQrRreadsrbytesrtimewriteswbyteswtimes rget_disk_countersr`s + * '   + ,kkme$cr"HNE1EfV  v;,&v;,&e*%v;&e*%e*% &%G'- -$ .% - ,$ .   . s5C5B<AB<2C< C C CC&%C&c6\rSrSrSrSrSrSrSrSr Sr g ) MetricsReporterz9Mix-in for tracking metrics during task status reporting.cN[Ul[Ul[5Ulgr0)UNSET_source_scheme_destination_schemer`_disk_counters_start)selfs r__init__MetricsReporter.__init__sD$D 1 3DrcBU(a[UR$[$)z;Extracts the scheme as an integer value from a storage_url.)PROVIDER_PREFIX_TO_METRICS_KEYschemere)riurls r_get_scheme_value!MetricsReporter._get_scheme_values +CJJ 77 LrcUR[:Xa URUR5UlUR[:Xa!URUR 5Ulgg)ztSets source and destination schemes, if available. Args: status_message (thread_messages.*): Message to process. N)rfrerp source_urlrgdestination_url)ristatus_messages r#_set_source_and_destination_schemes3MetricsReporter._set_source_and_destination_schemessZ  e# 22>3L3LMd 5(!%!7!7  ( ("*d)rc [RR5nU[RR:Xa{URn[ 5n[ UR5Vs/sH oDSUS-PM sn5[ UR5Vs/sH oDSUS-PM sn5- $[$s snfs snf)z&Calculate deltas of time spent on I/O.r'r() r OperatingSystemCurrentLINUXrhr`sumrYre)ri current_os disk_startdisk_endstats r_calculate_disk_io"MetricsReporter._calculate_disk_ios**224JY..444,,j"$h1BC1B7T!W$1BCD1B1B1DE1D7T!W$1DEFGH LDEs *B>C c [[U5[U5- 5n[URURUUUUR 5S9 g)zReports back all tracked events via report method. Args: total_bytes (int): Amount of data transferred in bytes. time_delta (int): Time elapsed during the transfer in seconds. num_files (int): Number of files processed r=N)roundfloatrDrfrgr)ri total_bytes time_deltar@rBs r_report_metricsMetricsReporter._report_metricssLeK(5+<<=I ))33 ,,. 0r)rgrhrfN) rr r!r"__doc__rjrprvrrr%rrrrbrbsA4 * 0rrb)r)#r __future__rrrenum"googlecloudsdk.command_lib.storager(googlecloudsdk.command_lib.storage.tasksrgooglecloudsdk.corerr googlecloudsdk.core.utilr r rEnumrProviderPrefixFILEGCSHTTPHTTPSPOSIXS3rmrer.r2r4rDrSr`rbrrrrs:&' :>'**. K $)) ##Q""A##Q$$a$$a!!1 " C. L5AQQ6,.(V7070r