"SrSSKJr SSKJr SSKJr SSKJr SSKJr SSKJr SSK J r SS K J r S r S S 0rS SSSSSSSSSSSSSS.rSSSSS S!S"S#S$S%S&S'S(S). r"S*S+\5r"S,S-\5r"S.S/\5r"S0S1\5r"S2S3\5r"S4S5\5r"S6S7\5r"S8S9\5r"S:S;\5r"S<S=\5rS>rS?rSCSAjrSCSBjrg@)DaGUtils for generating API-specific RequestConfig objects. RequestConfig is provider neutral and should be subclassed into a provider-specific class (e.g. GcsRequestConfig) by the factory method. RequestConfig can hold a BucketConfig or ObjectConfig. These classes also have provider-specific subclasses (e.g. S3ObjectConfig). )absolute_import)division)unicode_literals)encryption_util)errors) storage_url)log) debug_outputzapplication/octet-stream gzip_settingszGzip Transformsz(Setting Autoclass Terminal Storage ClasszSetting Default Object ACLzEnabling AutoclasszEnabling Hierarchical NamespacezSetting IP FilterzSetting Encryption EnforcementzSetting Predefined Default ACLzPublic Access Preventionz Setting Recovery Point ObjectivezSetting Retention PeriodzLocking Retention PeriodzSetting Custom ContextszRemoving Custom ContextszUpdating Custom Contexts) autoclass_terminal_storage_classdefault_object_acl_fileenable_autoclassenable_hierarchical_namespaceip_filter_file_path encryption_enforcement_file_pathpredefined_default_object_aclpublic_access_preventionrecovery_point_objectiveretention_periodretention_period_to_be_lockedcustom_contexts_to_setcustom_contexts_to_removecustom_contexts_to_updatezSetting Custom TimezSetting Default Encryption Keyz Setting Default Event Based HoldzSetting Default Storage ClasszEnabling Object RetentionzSetting Event-Based Holdsz Setting Dual-Region for a BucketzPreserving ACLszSetting Time to Retain UntilzSetting Retention ModezSetting Soft Delete PolicieszSetting Temporary Holdsz#Setting Uniform Bucket Level Access) custom_timedefault_encryption_keydefault_event_based_holddefault_storage_classenable_per_object_retentionevent_based_hold placement preserve_acl retain_untilretention_modesoft_delete_durationtemporary_holduniform_bucket_level_accessc4\rSrSrSrSSjrSrSrSrg) _ResourceConfigMaHolder for generic resource fields. Attributes: acl_file_path (None|str): Path to file with ACL settings. acl_grants_to_add (None|list[dict]): Contains API representations of ACL. For GCS, this looks like `{ 'entity': ENTITY, 'role': GRANT }`. acl_grants_to_remove: (None|list[str]): Identifier of entity to remove access for. Can be user, group, project, or keyword like "All". Nc(XlX lX0lg)z-Initializes class, binding flag values to it.N acl_file_pathacl_grants_to_addacl_grants_to_remove)selfr,r-r.s [[U] XU5 XlX@lXPlX`lXplXlXl Xl Xl Xl Xl Xlgr5)superrMr1locationcors_file_pathlabels_file_pathlabels_to_appendlabels_to_removelifecycle_file_path log_bucketlog_object_prefixrequester_pays versioningweb_error_pageweb_main_page_suffix)r/r,r-r.rRrSrTrUrVrQrWrXrYrZr[r\ __class__s r0r1_BucketConfig.__init__s^  -' (<>M(,,,2 O.( O( 4r3cr>[U[U55(d[$[[U]U5=(Ga| UR UR :H=(Ga[ URUR:H=(Ga: URUR:H=(Ga URUR:H=(a URUR:H=(a URUR:H=(a URUR:H=(a URUR:H=(ay URUR:H=(aY URUR:H=(a9 UR UR :H=(a UR"UR":H$r5)r6r7r8rPrMr;rRrSrTrUrVrQrWrXrYrZr[r\r/r:r]s r0r;_BucketConfig.__eq__s eT$Z ( (  - -e 4 D D   5#7#7 7 D D  ! !U%;%; ; D D  ! !U%;%; ; D D  ! !U%;%; ; D  $ $(A(A A D MMU^^ + D OOu// / D  " "e&=&= = D   5#7#7 7 D OOu// / D   5#7#7 7 D  % %)C)C C Er3) rRrSrTrUrVrQrWrXrYrZr[r\)NNNNNNNNNNNNNNN rErFrGrHrIr1r;rJ __classcell__r]s@r0rMrMlsH."!%$(" $ $ $#'!%""$(5>EEr3rMc^\rSrSrSrSU4SjjrU4SjrSrU=r$)_GcsBucketConfigaHolder for GCS-specific bucket fields. See superclass for remaining attributes. Subclass Attributes: autoclass_terminal_storage_class (str|None): The storage class that objects in the bucket eventually transition to if they are not ' read for a certain length of time. default_encryption_key (str|None): A key used to encrypt objects added to the bucket. default_event_based_hold (bool|None): Determines if event-based holds will automatically be applied to new objects in bucket. default_object_acl_file_path (str|None): File path to default object ACL file. default_object_acl_grants_to_add (list[dict]|None): Add default object ACL grants to an entity for objects in the bucket. default_object_acl_grants_to_remove (list[str]|None): Remove default object ACL grants. default_storage_class (str|None): Storage class assigned to objects in the bucket by default. enable_autoclass (bool|None): Enable, disable, or don't do anything to the autoclass feature. Autoclass automatically changes object storage class based on usage. enable_per_object_retention (bool|None): Enable the object retention for the bucket. enable_hierarchical_namespace (bool|None): Enable heirarchical namespace during bucket creation. placement (list|None): Dual-region of bucket. public_access_prevention (bool|None): Blocks public access to bucket. See docs for specifics: https://cloud.google.com/storage/docs/public-access-prevention recovery_point_objective (str|None): Specifies the replication setting for dual-region and multi-region buckets. retention_period (int|None): Minimum retention period in seconds for objects in a bucket. Attempts to delete an object earlier will be denied. soft_delete_duration (int|None): Number of seconds objects are preserved and restorable after deletion in a bucket with soft delete enabled. uniform_bucket_level_access (bool|None): Determines if the IAM policies will apply to every object in bucket. c#L>[[U] UUUUUUUUUUUUU U!U"5 X@lX`lXplXlXlXlU Ul Xl Xl Xl Xl UUlUUlUUlUUlUUlUUlUUlUUlUUlgr5)rPrfr1r rrrdefault_object_acl_file_path default_object_acl_grants_to_add#default_object_acl_grants_to_removerrrrrr rrrYrrr$r&)$r/r,r-r.r rRrrrrirjrkrrrrrrSrTrUrVrQrWrXr rrrYrrr$r&rZr[r\r]s$ r0r1_GcsBucketConfig.__init__sJ D*"-M)"8,L)$<!(D%,L)+ ,"7,'B$)F&2DDN$[U[U55(d[$[[U]U5=(Gac UR UR :H=(GaB URUR:H=(Ga! URUR:H=(Ga URUR:H=(Ga URUR:H=(Ga URUR:H=(Ga URUR:H=(Ga| URUR:H=(Ga[ URUR:H=(Ga: URUR:H=(Ga UR UR :H=(a UR"UR":H=(a UR$UR$:H=(a UR&UR&:H=(a UR(UR(:H=(ay UR*UR*:H=(aY UR,UR,:H=(a9 UR.UR.:H=(a UR0UR0:H$r5)r6r7r8rPrfr;r rrrrjrkrrrrrr rrrYrrr$r&r`s r0r;_GcsBucketConfig.__eq__+sy eT$Z ( (  ,U3 - -  1 1  1 1 2 - -  ' '5+G+G G - -  1 1  1 1 2  - -  ) )U-K-K K  - -  1 1  1 1 2 - -  4 4  4 4 5 - -  & &%*E*E E - -  ! !U%;%; ; - -  , ,  , , - - -  . .  . . / - -"  $ $(A(A A# -$ NNeoo -% -&  ) )U-K-K K' -(  ) )U-K-K K) -*   5#7#7 7+ -,  ! !U%;%; ;- -.  . .  . . // -2  % %)C)C C3 -4  , ,  , , -7r3)r rrrirjrkrrrrrrr rrrYrrr$r&)"NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNNrbrds@r0rfrfs'V'+!'+##''+*. "&$(##$("&GKCZ  r3rfc\rSrSrSrSrg)_S3BucketConfigiNzHolder for S3-specific bucket fields. See superclass for attributes. We currently don't support any S3-only fields. This class exists to maintain the provider-specific subclass pattern used by the request config factory. rKNrErFrGrHrIrJrKr3r0rprpNsr3rpcd^\rSrSrSrSU4SjjrU4SjrSrU=r$) _ObjectConfigiWaHolder for storage object settings shared between cloud providers. Superclass and provider-specific subclasses may add more attributes. Attributes: cache_control (str|None): Influences how backend caches requests and responses. content_disposition (str|None): Information on how content should be displayed. content_encoding (str|None): How content is encoded (e.g. "gzip"). content_language (str|None): Content's language (e.g. "en" = "English). content_type (str|None): Type of data contained in content (e.g. "text/html"). custom_contexts_to_set (dict|None): Custom contexts fields set by user. custom_contexts_to_remove (dict|None): Custom contexts fields to be removed by user. custom_contexts_to_update (dict|None): Custom contexts field to be added or changed by user. custom_fields_to_set (dict|None): Custom metadata fields set by user. custom_fields_to_remove (dict|None): Custom metadata fields to be removed. custom_fields_to_update (dict|None): Custom metadata fields to be added or changed. decryption_key (encryption_util.EncryptionKey): The key that should be used to decrypt information in GCS. encryption_key (encryption_util.EncryptionKey|None|CLEAR): The key that should be used to encrypt information in GCS or clear encryptions (the string user_request_args_factory.CLEAR). md5_hash (str|None): MD5 digest to use for validation. preserve_acl (bool): Whether or not to preserve existing ACLs on an object during a copy or other operation. size (int|None): Object size in bytes. storage_class (str|None): Storage class for cloud object. If None, will use bucket's default. c>[[U] XU5 X@lXPlX`lXplXlXlXl Xl Xl Xl Xl XlUUlUUlUUlUUlUUlgr5)rPrsr1 cache_controlcontent_dispositioncontent_encodingcontent_language content_typerrrcustom_fields_to_setcustom_fields_to_removecustom_fields_to_updatedecryption_keyencryption_keymd5_hashr!size storage_class)r/r,r-r.rurvrwrxryrrrrzr{r|r}r~rr!rrr]s r0r1_ObjectConfig.__init__{s. -'*>'2,,$"8%>"%>" 4#: #: ((DDM$DDI&Dr3c>[U[U55(d[$[[U]U5=(Ga! UR UR :H=(Ga URUR:H=(Ga URUR:H=(Ga URUR:H=(Ga URUR:H=(Ga| URUR:H=(Ga[ URUR:H=(Ga: URUR:H=(Ga URUR:H=(a URUR:H=(a UR UR :H=(a UR"UR":H=(a UR$UR$:H=(ay UR&UR&:H=(aY UR(UR(:H=(a9 UR*UR*:H=(a UR,UR,:H$r5)r6r7r8rPrsr;rurvrwrxryrrrrzr{r|r}r~rrr!rr`s r0r;_ObjectConfig.__eq__s eT$Z ( (  mT)%0 6 6   %"5"5 5 6 6  $ $(A(A A 6 6  ! !U%;%; ; 6 6  ! !U%;%; ;  6 6   !3!3 3  6 6  ' '5+G+G G  6 6  * *e.M.M M 6 6  * *e.M.M M 6 6  % %)C)C C 6  ( (E,I,I I 6  ( (E,I,I I 6   5#7#7 7 6   5#7#7 7 6 MMU^^ + 6 II # 6   !3!3 3! 6"   %"5"5 5%r3)rurvrwrxryrrrr{rzr|r}r~rr!rr)NNNNNNNNNNNNNNNNNNNNrbrds@r0rsrsWsW!J! $ $"" +*'Xr3rscj^\rSrSrSrSU4SjjrU4SjrSrU=r$)_GcsObjectConfigiaQArguments object for requests with custom GCS parameters. See superclass for additional attributes. Attributes: event_based_hold (bool|None): An event-based hold should be placed on an object. custom_time (datetime|None): Custom time user can set. retain_until (datetime|None): Time to retain the object until. retention_mode (flags.RetentionMode|None|CLEAR): The key that should be used to set the retention mode policy in GCS or clear retention (the string user_request_args_factory.CLEAR). temporary_hold (bool|None): A temporary hold should be placed on an object. c>[[U] UUUUUUUUU U U U U UUUUUS9 XlUUlUUlUUlUUlg)N)r,r-r.rurvrwrxryrrrrzr{r|r}r~rr)rPrr1rrr"r#r%)r/r,r-r.rurvrwrxryrrrrzr{r|rr}r~rrr"r#rr%r]s r0r1_GcsObjectConfig.__init__sx4 D*#+1#/))!5";";1 7 7%% %+&#,D$D(D(Dr3c>[U[U55(d[$[[U]U5=(a UR UR :H=(ay URUR:H=(aY URUR:H=(a9 URUR:H=(a URUR:H$r5) r6r7r8rPrr;rrr"r#r%r`s r0r;_GcsObjectConfig.__eq__s eT$Z ( (  "D 0 7 8    1 1 1 8  ! !U%;%; ; 8   !3!3 3 8   5#7#7 7  8   5#7#7 7 9r3)rrr"r#r%)NNNNNNNNNNNNNNNNNNNNNNNrbrds@r0rrs_ $! $ $"" 11)f99r3rc\rSrSrSrSrg)_S3ObjectConfigizBWe currently do not support any S3-specific object configurations.rKNrqrKr3r0rrsJr3rc8\rSrSrSrSSjrSrSrSrg) _RequestConfigia$Holder for parameters shared between cloud providers. Provider-specific subclasses may add more attributes. Attributes: predefined_acl_string (str|None): ACL to set on resource. predefined_default_object_acl_string (str|None): Default ACL to set on resources. preserve_posix (bool|None): Whether to apply source POSIX metadata to destination. preserve_symlinks (bool|None): Whether symlinks should be preserved rather than followed. resource_args (_BucketConfig|_ObjectConfig|None): Holds settings for a cloud resource. NcBXlUUlX0lX@lXPlgr5predefined_acl_string$predefined_default_object_acl_stringpreserve_posixpreserve_symlinks resource_args)r/rrrrrs r0r1_RequestConfig.__init__$s)"7, -).&r3ct[U[U55(d[$URUR:H=(ay URUR:H=(aY UR UR :H=(a9 UR UR :H=(a URUR:H$r5)r6r7r8rrrrrr9s r0r;_RequestConfig.__eq__4s eT$Z ( (  ""e&A&AA 6  5 5  5 5 6 6   5#7#7 7 6  " "e&=&= =  6   %"5"5 5 r3c.[R"U5$r5r>r@s r0rA_RequestConfig.__repr__@rCr3r)NNNNNrDrKr3r0rrs'$!+/ ' +r3rcL^\rSrSrSrSU4SjjrU4SjrSrU=r$)_GcsRequestConfigiEaHolder for GCS-specific API request parameters. See superclass for additional attributes. Attributes: gzip_settings (user_request_args_factory.GzipSettings): Contains settings for gzipping uploaded files. no_clobber (bool): Do not copy if destination resource already exists. override_unlocked_retention (bool|None): Needed as confirmation for some changes to object retention policies. precondition_generation_match (int|None): Perform request only if generation of target object matches the given integer. Ignored for bucket requests. precondition_metageneration_match (int|None): Perform request only if metageneration of target object/bucket matches the given integer. c h>[[U] UUUS9 XlX lX0lX@lXPlg)N)rrr)rPrr1r no_clobberoverride_unlocked_retentionprecondition_generation_match!precondition_metageneration_match) r/r rrrrrrrr]s r0r1_GcsRequestConfig.__init__WsB T+3 0# ,% ' O'B$)F&-N*r3c>[U[U55(d[$[[U]U5=(a UR UR :H=(ay URUR:H=(aY URUR:H=(a9 URUR:H=(a URUR:H$r5) r6r7r8rPrr;r rrrrr`s r0r;_GcsRequestConfig.__eq__ms eT$Z ( (  -e4 3   %"5"5 5 3 OOu// / 3  , ,  , , - 3  . .  . . /  3  2 2  2 2 3 r3)r rrrr)NNNNNNNNrbrds@r0rrEs2&"&$((, +/O,  r3rc\rSrSrSrSrg)_S3RequestConfigi}zHolder for S3-specific API request parameters. Currently just meant for use with S3ObjectConfig and S3BucketConfig in the parent class "resource_args" field. rKNrqrKr3r0rr}sr3rcr/nUH%n[XS5cMURX5 M' [U5$)z@Takes user_args and unsupported_fields and returns feature list.N)getattrappendsorted) user_argsunsupported_fieldsresultfields r0,_extract_unsupported_features_from_user_argsrs: &!ey&2 mm&-." r3c[USS5nU(a[USS5(dSUl[U[5[U[5-nU(a4[ R "SRSRU555e[U[5nU(a5[R"SRSRU555 gg)z=Raises error or logs warning if unsupported S3 field present.rNrzFeatures disallowed for S3: {}z, z(Some features do not have S3 support: {}) rrrS3_REQUEST_ERROR_FIELDSS3_RESOURCE_ERROR_FIELDSrErrorformatjoinS3_RESOURCE_WARNING_FIELDSr warning)user_request_argsuser_resource_argserror_fields_presentwarning_fields_presents r0 _check_for_unsupported_s3_fieldsrs0/4H94!A!A7;423D3JL23E3KMM  ,,(// :N0OP H46KK:AA ()+,r3Nc [U[R5(dg[USS5nSn UR 5(GaUR [R ;GaUR [RR:XGaV[5n U(GaCURU l URU l URU l URU l URU lURU lUR U lUR"U lUR$U lUR&U lUR(U lUR*U lUR,U lUR.U lUR0U lUR2U lUR4U lUR6U lUR8U lOHUR [RR::Xa[=5n [?U5 O [A5n [USS5U l![USS5U l"[USS5U l#[USS5U l$[USS5U l%[USS5U l&[US S5U l'[US S5U l([US S5U l)[US S5U l*[US S5U l+[USS5U l,GOUR[5(GaUR [RR:Xag[]5n U(aUUR^U l/UR`U l0URbU l1URdU l2URfU l3OHUR [RR::Xa[i5n [?U5 O [k5n Xl6XYl7Xil8U=(d [rRt"5U l;U(a$[rRx"X$(aUOS5U l=U(GaDURlb.URl(aURlU l6O [|U l6URnbURnU l7UR~U l?URU l@URU lAURU lBURU lCURU lDURU lEURU lFURU lGURU lHURU lIUR(aURR5U lJU (a:U(a3URU lLURU lMURU lNU $)z@Generates metadata for API calls to storage buckets and objects.NrrQrRrSrTrUrVrWrXrYrZr[r\)Or6rCloudUrlr is_bucketschemeVALID_CLOUD_SCHEMESProviderPrefixGCSrfr rrrrirjrkrrrrrr rrrrr$r&S3rprrMrQrRrSrTrUrVrWrXrYrZr[r\ is_objectrrrr"r#r%rrsryrrrget_encryption_keyr~get_decryption_keyr}DEFAULT_CONTENT_TYPErurvrwrxrzr{r|rrrr!rupperr,r-r.) urlrydecryption_key_hash_sha256r~error_on_missing_keyrrrrnew_resource_argss r0!_get_request_config_resource_argsrs C-- . . 0/4H]]__ zz[444 {1155 5,.  AA  <!77  2!AA  <!99  4!==  8!AA  <!DD  ?!66  1!11  ,!<<  7!>>  9!44  /);(D(D  % 99  4!99  4!11  ,!>>  9!55  0!<<  7 ::3366 6+-():;(/!();Z!N'.,d(4$)0.*6&)0.*6&)0.*6&,314-9)#*L$$0 *1/+7''./A/?(G$#*L$$0 '.,d(4$-42D.:* }} zz[//333*, (:(F(F%-?-P-P*);)H)H&+=+L+L(+=+L+L( {1144 4)+&'89(/%1"!)! >/<<>$!)8)K)K $-Act*M&  ( ( 4  * *+=+J+J  (+?  (  $ $ 0%7%@%@"(:(H(H%  0 0+,>+N+N(+=+N+N(  1 1,  4 4/  4 4/  3 3.  6 61  6 61(:'F'F$  ) )  , , 2 2 4 '-&8&F&F#*<*N*N'//* r3c [XX#XEXg5nUR[RR:Xa[ US9n U(aUR U lURU lUR(aURU lUR(a[UR5U l UR(a[UR5U l O;UR[RR:Xa [US9n O [US9n [USS5U l[USS5U l[USS5U l[USS5U lU(aUR(U lU $SU lU $)zFGenerates API-specific RequestConfig. See output classes for arg info.)rriNrrr)rrrrrrr rrrintrrrrrrirrrr) rryrr~rrrrrrequest_configs r0get_request_configrTso4 3d?- ZZ;--111&]CN%6%D%Dn"  7 70  % %$5$@$@!  8 87:  ; ;8=4  < <;>  ? ?rso''>5:#12 & 3;,%F.(H%E : B2%?7!;!;!&)> B<#>33%2.:/#H"+f+>EEOEEPW}WtmfOfRL9}L9^KmK.+V.+d55p~,248AE59;?/3+/8<k`#  /r3