+SrSSKJr SSKJr SSKJr SSKJr SSKrSSKrSSKrSSK J r SSK J r SS K Jr SSKJs Jr SS KJr SS KJr SS KJr SS KJr Sr"SS\R25r"SS\R25rg)z4Unit tests for hashing helper functions and classes.)absolute_import)print_function)division)unicode_literalsN)mock)CommandException)StorageUrlFromString)TRANSFER_BUFFER_SIZE)CalculateMd5FromContents)GetMd5)HashingFileUploadWrapperztest.txtc\rSrSrSr\R R\S5S5r \R R\S5S5r Sr g) TestGetMd5&z#Unit tests for the GetMd5 function.md5cjSUlUR[S5S5 URS5 g)Nhash) return_value assertEqualr assert_called_once_withselfmock_md5s 2platform/gsutil/gslib/tests/test_hashing_helper.py testGetsMd5HashOnNonRedHatSystem+TestGetMd5.testGetsMd5HashOnNonRedHatSystem)s.#HVC[&) $$S)rc [S/UlUR[S5S5 URUR[ R "S5[ R "SSS9/5 g)NrrF)usedforsecurity) ValueError side_effectrr mock_callsrcallrs rtestGetsMd5HashOnRedHatSystem(TestGetMd5.testGetsMd5HashOnRedHatSystem1sX '/HVC[&) 33>?ArN) __name__ __module__ __qualname____firstlineno____doc__rpatchobjecthashlibrr$__static_attributes__r&rrrr&sO+::We$*%*::We$A%Arrcn\rSrSrSrSr\"S5rSrSr Sr Sr S r S r S rS rS rSrSrSrg)TestHashingFileUploadWrapper=z2Unit tests for the HashingFileUploadWrapper class.Nzgs://bucket/objectc[R"SS[-5nUR(dUR [US9UlUR$)Ngslibztests/test_data/%s) file_namecontents)pkgutilget_data _TEST_FILE_temp_test_fileCreateTempFile)rr6s r _GetTestFile)TestHashingFileUploadWrapper._GetTestFileCsM)= )JKH   !00::B1Dd   rcS[50nURS[-S-S9n[US5n[ X1S[0UR UR 5nUR5 SSS5 [US5n[U5nSSS5 URWUSR55 g!,(df  NR=f!,(df  NC=f)Nra)r6rb) r r;r openr _dummy_urlloggerreadr r hexdigest)r digesterstmp_filestreamwrapperactuals r testReadToEOF*TestHashingFileUploadWrapper.testReadToEOFJs!I""D3G,G!,K"LH h (UFO)-$++Gg lln  h '/f VYu-779:    s9B7? C7 C Cc UR5n[RRU5nUR XSU<SU<S35 UR XSU<SU<S35 S[ 50n[US5n[XeS[ 0URUR5nSnX[- :a1UR[5n U[U 5- nX[- :aM1URX- 5 URX- 5 URUR!5X- 5 UR5n UR[U 5XAU- - 5 SSS5 [US5n[#U5n SSS5 URW USR%55 g!,(df  NR=f!,(df  NC=f) a2Tests reading then seeking backwards. This function simulates an upload that is resumed after a connection break. It reads one transfer buffer at a time until it reaches initial_position, then seeks backwards (as if the server did not receive some of the bytes) and reads to the end of the file, ensuring the hash matches the original file upon completion. Args: initial_position: Initial number of bytes to read before seek. seek_back_amount: Number of bytes to seek backward. Raises: AssertionError on wrong amount of data remaining or hash mismatch. z4seek_back_amount must be less than initial position  (but was actually: )z2initial_position must be less than test file size rrArN)r<ospathgetsizeassertGreaterEqual assertLessr rBr rCrDr rElenseekrtellr rF) rinitial_positionseek_back_amountrH tmp_file_lenrGrIrJpositiondatarKs r _testSeekBack*TestHashingFileUploadWrapper._testSeekBackUs   "H77??8,L*$46F HI OO,$02B DE !I h (UFO)-$++Ggh *>> >||01CI *>> >ll#./ ll#67 w||~'7'JK \\^d s4y#:J'JKM  h '/f VYu-779:    s >A&F*&A8F*2 F;* F8; G c [S- [[S-[S-S- [S-[S-S-[S-S- [S-[S-S-4 HnURX5 M gNr r^)r num_bytess rtestSeekToBeginning0TestHashingFileUploadWrapper.testSeekToBeginningsu*Q.0D*Q.0Dq0H10L*Q.0Dq0H10L*Q.24H14L*Q.2 4  . 4rc[S-[S-S- [S-[S-S-[S-S- [S-[S-S-4H2n[S- [[S-4HnURX5 M M4 grarerrYrZs rtestSeekBackAroundOneBuffer8TestHashingFileUploadWrapper.testSeekBackAroundOneBuffers1A51A591A51A591A591A51A59 ; 4a79M3a79  +>9;rc[S-S-[S-S- [S-[S-S-4H;n[S-S- [S-[S-S-4HnURX5 M M= g)Nrcrbrdrerjs rtestSeekBackMoreThanOneBuffer:TestHashingFileUploadWrapper.testSeekBackMoreThanOneBuffers1A591A591A51A59; 4a7!;3a73a7!;=  +>= ;rc UR5n[RRU5nUR XSU<SU<S35 S[ 50n[ US5n[XTS[ 0URUR5nURU5 URUR5U5 UR5nUR[U5X1- 5 SSS5 [ US5n[U5nSSS5 URWUSR!55 g!,(df  NR=f!,(df  NC=f)aTests seeking to an initial position and then reading. This function simulates an upload that is resumed after a process break. It seeks from zero to the initial position (as if the server already had those bytes). Then it reads to the end of the file, ensuring the hash matches the original file upon completion. Args: initial_seek: Number of bytes to initially seek. Raises: AssertionError on wrong amount of data remaining or hash mismatch. z.initial_seek must be less than test file size rOrPrrAN)r<rQrRrSrUr rBr rCrDrWrrXrErVr rF) r initial_seekrHr[rGrIrJr]rKs r_testSeekForward-TestHashingFileUploadWrapper._testSeekForwards  "H77??8,LOOl$0, @A !I h (UFO)-$++Gg ll<  w||~|4 \\^d s4y,"=>  h '/f VYu-779:    s#BD6> E6 E EcS[S- [[S-[S-S- [S-[S-S-4HnURU5 M gNrrbrc)r rr)rrqs rtestSeekForward,TestHashingFileUploadWrapper.testSeekForwardsV0146J-13G!3Ka3O-1-1A57  L) 7rc pUR5n[RRU5nUR XSU<SU<S35 S[ 50n[ US5n[XTS[ 0URUR5nURU5 URUR5U5 URS[R5 URUR5U5 URU[R5 UR5nUR[!U5X1- 5 SSS5 [ US5n[#U5nSSS5 URWUSR%55 g!,(df  NR=f!,(df  NC=f)aTests reading to an initial position and then seeking to EOF and back. This function simulates an size check on the input file by seeking to the end of the file and then back to the current position. Then it reads to the end of the file, ensuring the hash matches the original file upon completion. Args: initial_read: Number of bytes to initially read. Raises: AssertionError on wrong amount of data remaining or hash mismatch. z.initial_read must be less than test file size rOrPrrArN)r<rQrRrSrUr rBr rCrDrErrXrWSEEK_ENDSEEK_SETrVr rF) r initial_readrHr[rGrIrJr]rKs r _testSeekAway*TestHashingFileUploadWrapper._testSeekAwaysK  "H77??8,LOOl$0, @A !I h (UFO)-$++Gg ll<  w||~|4 ll1bkk" w||~|4 ll<- \\^d s4y,"=>  h '/f VYu-779:    s#C'F F' F$' F5cS[S- [[S-[S-S- [S-[S-S-4HnURU5 M gru)r r|)rr{s rtestValidSeekAway.TestHashingFileUploadWrapper.testValidSeekAwaysV0146J-13G!3Ka3O-1-1A57  & 7rcUR5nS[50n[US5n[X2S[0URUR 5nUR [5 URS[R5 UR 5 URS5 SSS5 g![a%nURS[U55 SnAN3SnAff=f!,(df  g=f)zETests seeking to EOF and then reading without first doing a SEEK_SET.rrArz+Expected CommandException for invalid seek.z:Read called on hashing file pointer in an unknown positionN)r<r rBr rCrDrEr rWrQryfailrassertInstr)rrHrGrIrJes rtestInvalidSeekAway0TestHashingFileUploadWrapper.testInvalidSeekAways  "H!I h (UFO)-$++Gg ll'( ll1bkk"  ?@   H F    s0AC$!B22 C!<CC$C!!C$$ C2)r:)r'r(r)r*r+r:r rCr<rLr^rgrkrnrrrvr|rrr/r&rrr1r1=sO:/#$89*  ;,;\/ ?? ;D*#;J'rr1)r+ __future__rrrrr.rQr7unittestrgslib.exceptionrgslib.storage_urlr gslib.tests.testcaseteststestcasegslib.utils.constantsr gslib.utils.hashing_helperr r r r9GsUtilUnitTestCaserr1r&rrrsg;&%' ,2''6?-?  A,,A.H8#>#>Hr