SrSSKJr SSKJr SSKJr SSKrSSKrSSKJr SSKJ r SSKJ r "S S \ R5r g) zJImplements a file wrapper used for in-flight retries of streaming uploads.)absolute_import)division)unicode_literalsN)errors) hash_util) upload_streamc^\rSrSrSrS U4SjjrSrSrSrSr Sr SU4S jjr \ R4S jrS rS rU=r$)BufferedUploadStreamzHSupports limited seeking within a non-seekable stream by buffering data.c>[TU]USUUS9 [R"5UlX lSUlSUlSUl[R"UR5Ul g)aInitializes a FilePart instance. Args: stream (io.IOBase): The underlying stream wrapped by this class. max_buffer_size: Maximum size of the internal buffer. This should be >= to the chunk size used by the API to execute streaming uploads to ensure that at least one full chunk write can be repeated in the event of a server error. digesters (dict[util.HashAlgorithm, hashlib hash object]|None): See super class. progress_callback (func[int]|None): See super class. N)streamlength digestersprogress_callbackr) super__init__ collectionsdeque_buffer_max_buffer_size _buffer_start _position _buffer_endrcopy_digesters _digesters_checkpoint_digesters)selfr max_buffer_sizerr __class__s @lib/googlecloudsdk/command_lib/storage/buffered_upload_stream.pyrBufferedUploadStream.__init__!sk" )T#+ $- $$&DL+DDND!*!9!9$//!JDcUR$Nrrs r _get_absolute_position+BufferedUploadStream._get_absolute_position@s >>r"cXlgr$r%)roffsets r _update_absolute_position.BufferedUploadStream._update_absolute_positionCsNr"c/nUnURUR:aURnURHnU[ U5-UR:aWURU- n[ U5U- n[ Xs5nUR XVUU-5 X8-nU=RU- slU[ U5- nM SRU5$)aGet any buffered data required to complete a read. If a backward seek has not happened, the buffer will never contain any information needed to complete a read call. Return the empty string in these cases. If the current position is before the end of the buffer, some of the requested bytes will be in the buffer. For example, if our position is 1, five bytes are being read, and the buffer contains b'0123', we will return b'123'. Two additional bytes will be read from the stream at a later stage. Args: amount (int): The total number of bytes to be read Returns: A byte string, the length of which is equal to `amount` if there are enough buffered bytes to complete the read, or less than `amount` if there are not. r")rrrrlenminappendjoin) ramount buffered_databytes_remainingposition_in_bufferdataoffset_from_positionbytes_to_read_this_block read_sizes r _read_from_buffer&BufferedUploadStream._read_from_bufferFs(MO ~~(((--,,$ D )T^^ ;!%2D!D %(Y1E%E "2D)   t9M$-:. / 0  &/ ..I %.c$i' 88M ""r"cg)aDisables parent class digester checkpointing behavior. To guarantee that seeks within the buffer are possible, we need to ensure that the checkpoint is aligned with the buffer's start_byte. This is not possible if we save digester checkpoints when the parent class does so. Nr&s r _save_digesters_checkpoint/BufferedUploadStream._save_digesters_checkpointks r"cU(GanURRU5 U=R[U5- slSnURUR- UR :Ga URR 5nU=R[U5- slU(aUR URUR- - nUS:a3URRX#*S5 U=RU-sl[R"URUS[U5U- 5 URUl URUR- UR :aGM ggg)aXAdds data to the buffer, respecting max_buffer_size. The buffer can consist of many different blocks of data, e.g. [b'0', b'12', b'3'] With a maximum size of 4, if we read two bytes, we must discard the oldest data and keep half of the second-oldest block: [b'2', b'3', b'45'] Args: data (bytes): the data being added to the buffer. N) rr0rr.rrpopleft appendleftrupdate_digestersr_checkpoint_absolute_index)rr6 oldest_data refill_amounts r _store_data BufferedUploadStream._store_datats:  ll$ #d)#k   t11 1D4I4I Ill**,  c+.. //!3!335- a  LL # #K$@ A   - /   $ $((;3{+m;< >-1,>,>$ )   t11 1D4I4I I I  r"cT>USL=(d US:nU(a URnOUnURU5nU[U5-nU(a[TU]S5nOU(a[TU]U5nOSnU=R [U5- slUR U5 XE-$)zReads from the wrapped stream. Args: size: The amount of bytes to read. If omitted or negative, the entire stream will be read and returned. Returns: Bytes from the wrapped stream. Nrr")rr:r.r _get_datarrH)rsizeread_all_bytesr4r6new_datars r rLBufferedUploadStream._get_datasT\-TAXN--oo  ! !/ 2Ds4y Oy$1"5h y$1/BhhNNc(m#NX ?r"cU[R:Xa[XR:dXR:a:[R "SR XRUR55eUnOU[R:Xa[U5UR:a/[R "SR XR55eURUR5(a#URUR5(aM#URU-nO%[R "SR X!55eURU5 X0l g)z!Seeks within the buffered stream.zUnable to recover from an upload error because limited buffering is available for streaming uploads. Offset {} was requested, but only data from {} to {} is buffered.zNInvalid SEEK_END offset {} on streaming upload. Only {} bytes can be buffered.z;Invalid seek mode on streaming upload. Mode: {}, offset: {}N) osSEEK_SETrrrErrorformatSEEK_ENDabsrreadr_catch_up_digesters)rr*whence new_positions r seekBufferedUploadStream.seeks  $$ $1A1A(All 44:F**D,<,<5>? ? l 2;;  Vt,, ,ll &v/D/D EG G IId++ , ,  IId++ , ,^^f,l LL G N N   \*!Nr"cg)aYIndicates that this stream is not seekable. Needed so that boto3 can correctly identify how to treat this stream. The library attempts to seek to the beginning after an upload completes, which is not always possible. Apitools does not check the return value of this method, so it will not raise issues for resumable uploads. Returns: False Fr=r&s r seekableBufferedUploadStream.seekables r")rrrrErrr)NN)rK)__name__ __module__ __qualname____firstlineno____doc__rr'r+r:r>rHrLrRrSr\r___static_attributes__ __classcell__)rs@r r r sMP !% K>##J "?H@!# "8  r"r ) re __future__rrrrrR"googlecloudsdk.command_lib.storagerrr UploadStreamr r=r"r rks7 Q&' 58<C=55Cr"