T@(%SrSSKJr SSKrSSKJrJrJrJr SSK J r \\ \ \ 4r\ \S'\\ \\ S44r\ \S'S\\ \4S \\ 4S jrS \\ S \\ 4S jr"S S\5r\R*S:a;\\/\4r\ \S'\\\\ /\4r\ \S'\\ \ \ /\ 4r\ \S'\\ /\ 4r\ \S'O\r\ \S'\r\ \S'\r\ \S'\r\ \S'"SS5r"SS\5rS\\ \4S\\ \4S \\ \44Sjr"SS5r"SS5rg)zIThe classes used to define config used to delegate BQ commands to gcloud.)CallableN)DictListOptionalUnion) TypeAliasPrimitiveFlagValue NestedStrDict mapped_flagsreturnc  /nUR5Hmup#[U[5(d"URSUS[ U535 M<U(aURSU35 MYURSU35 Mo U$)z8Returns the gcloud command flags as an array of strings.--=z--no-)items isinstanceboolappendstr)r flag_arraynamevalues 9platform/bq/gcloud_wrapper/bq_to_gcloud_config_classes.py_flatten_flag_dictionaryr s}*!'')kd eT " ""TF!CJ<01 "TF $%v' *  command_arrayc/nUH]nURS5(a3SU;a-URS5up4nURUSUS35 MLURU5 M_ U$)z?Returns the gcloud command flags after quoting the flag values.rrz='') startswith partitionr)rresultcommand_or_flagr_rs rquote_flag_valuesr#sj&&o!!$''C?,B(2237t mmtfBugQ'( mmO$ ' -rc\rSrSrSrSrg)!BigqueryGcloudDelegationUserError(z9Class to represent a user error during gcloud delegation.N)__name__ __module__ __qualname____firstlineno____doc____static_attributes__r'rrr%r%(sArr%) ConvertFlagValuesFunctionConvertJsonFunctionConvertStatusFunctionMatchOutputFunctioncL\rSrSrSrS S\S\S\\4SjjrS\ S \ 4S jr S r g) FlagMapping>zDefines how to create a gcloud command flag from a bq flag. For example this would return True: FlagMapping( bq_name='httplib2_debuglevel', gcloud_name='log-http', bq_to_gcloud_mapper=lambda x: x > 0, ).bq_to_gcloud_mapper(1) Nbq_name gcloud_namebq_to_gcloud_mappercZXlX lU(aX0lgURUlgN)r8r9r:$default_map_bq_value_to_gcloud_value)selfr8r9r:s r__init__FlagMapping.__init__Js& L"!4!%!J!Jdr bq_flag_valuer c[U[5(a U=(d S$[U[5(aU$[U5$)zCTakes a bq flag value and returns the equivalent gcloud flag value.F)rrintr)r>rAs rr=0FlagMapping.default_map_bq_value_to_gcloud_valueXs:-&&  #e# M3 ' '   r)r8r:r9r<) r(r)r*r+r,rrr1r?r r=r-r'rrr6r6>sN BF K K K$$=> K  -    rr6c8^\rSrSrSrS\S\4U4SjjrSrU=r$)UnsupportedFlagMappingdz9Defines a bq global flag that is not supported in gcloud.r8 error_messagec>^S[[[4S[[[44U4Sjjn[TU]USU5 g)Nxr c>[T5er<)r%)rJrHs rraise_unsupported_flag_errorEUnsupportedFlagMapping.__init__..raise_unsupported_flag_errorls -m <r8rHrL __class__s ` rr?UnsupportedFlagMapping.__init__gs= =c4i(8=U39=M= GW02NOrr') r(r)r*r+r,rr?r- __classcell__)rPs@rrFrFds&APPPPrrF flag_mappingsbq_flagsc0nUR5H9up4X0;a[SU35eXnURU5X%R'M; U$)aaReturns the equivalent gcloud flags for a set of bq flags. Args: flag_mappings: The flag mappings to use. For example, {'project_id': FlagMapping('project_id', 'project')} bq_flags: The bq flags that will be mapped. For example, {'project_id': 'my_project'} Returns: The equivalent gcloud flags. For example, {'project': 'my_project'} zUnsupported bq flag: )r ValueErrorr:r9)rSrT gcloud_flagsbq_flagrA flag_mappers r_convert_to_gcloud_flagsrZrsb , ( 0g# .wi8 99(K,7,K,K-L(() !1 rcP\rSrSrSrSS\S\S\\S\\\S\\S \\S \\ S \\ S \\ S \ S\ 4Sjjr \S\\\44Sj5rSS\S\\S\4SjjrS\\S\4SjrS\\\4S\\\44SjrSS\\S\\\4S\\S\\4SjjrSrg)CommandMappingaiStores the configuration to map a BQ CLI command to gcloud. This class does not include the global flags. These are handled at a higher level in the system. Example usage: CommandMapping( resource='datasets', bq_command='ls', gcloud_command=['alpha', 'bq', 'datasets', 'list'], flag_mapping_list=[ FlagMapping( bq_name='max_results', gcloud_name='limit', ), ], ).get_gcloud_command_minus_global_flags( bq_format='pretty', bq_command_flags={'max_results': 5}, ) Results in: ['alpha', 'bq', 'datasets', 'list', '--format=table[box]', '--limit=5'] Nresource bq_commandgcloud_commandflag_mapping_listtable_projectioncsv_projection json_mappingstatus_mapping$synchronous_progress_message_matcherprint_resource no_promptsc XlX lX0lU=(d /UlSUlXPlX`lU(aUOSUlU(aXlOSUlU (aU Ul OSUl Xl Xl g)aInitializes the CommandMapping. Args: resource: The resource this command targets. For example, 'datasets'. bq_command: The bq command to map. For example, 'ls'. gcloud_command: The gcloud command that will be mapped to. For example, ['alpha', 'bq', 'datasets', 'list']. flag_mapping_list: The flag mappings for this command. For example, [FlagMapping('max_results', 'limit')] table_projection: An optional projection to use for the command when a table is displayed. For example: 'datasetReference.datasetId:label=datasetId'. csv_projection: An optional projection to use for the command when the output is in csv format. For example: 'datasetReference.datasetId:label=datasetId'. json_mapping: A function to map the json output from gcloud to bq. For example, lambda x: {'kind': 'bigquery#project', 'id': x['projectId']} status_mapping: A function to map the status output from gcloud to bq. For example, lambda orig, id, project: f'Dataset {project}:{id} deleted.' synchronous_progress_message_matcher: A function to match a progress message from gcloud when running a synchronous command. For example, lambda message: 'Waiting for job' in message. print_resource: If the command also prints the resource it is operating on. For example, 'ls' will list resources but 'rm' usually prints status and not the resource. no_prompts: Some commands need a prompt to be disabled when they're run and usually, the BQ CLI code flow will have done this already. For example, the when `bq rm -d` is run, the BQ CLI will prompt the user before deleting the dataset, so the gcloud prompt is not needed. NcU$r<r')rJr"s r)CommandMapping.__init__..sqrcU$r<r')original_statusr"__s rrkrls?rcg)NFr')r"s rrkrlsEr) r^r_r`ra_flag_mappingsrbrcrdrerfrgrh) r>r^r_r`rarbrcrdrerfrgrhs rr?CommandMapping.__init__sw\M O(.4"D26D,((4 .D*Jd+ . /3Bd/( Orr cUR(d20UlURHnXRUR'M UR$)z2Returns the command flag mappings as a dictionary.)rqrar8)r> flag_mappings rrSCommandMapping.flag_mappingssE   d00,4@L0011   rprefixlabelsc$U(aUSUS3$U$)z Returns the format from the map.()r')r>rvrws r_add_fields_to_format$CommandMapping._add_fields_to_formats xq "" mr bq_formatcU(a US:XdUS:XaURSUR5$SU;agSU;aURSUR5$[SU35e)z2Returns the gcloud format for the given bq format.prettysparsez table[box]jsoncsvzUnsupported format: )r{rbrcrV)r>r}s rget_gcloud_format CommandMapping.get_gcloud_formatsm  X-h1F  ' ' d6K6K LL 9   )   ' 't/B/B CC -i[9 ::rrTc.[URU5$)z0Returns the gcloud flags for the given bq flags.)rZrS)r>rTs r_get_gcloud_flags CommandMapping._get_gcloud_flags s $D$6$6 AArbq_command_flags identifierclURR5nUR(a%URU5nUR SU35 UR [ URU555 UR(aUR S5 U(aUR U5 U$)a$Returns the gcloud command to use for the given bq command. Args: bq_format: The `format` flag from the BQ CLI (eg. 'json'). bq_command_flags: The flags for this BQ command that will be mapped. For example, {'max_results': 5} identifier: An optional identifier of the resource this command will operate on. Returns: The equivalent gcloud command array with the leading 'gcloud' removed, with the format flag and command flags but no global flags. For example, ['alpha', 'bq', 'datasets', 'list', '--format=json', '--limit=5'] z --format=z--quiet) r`copyrgrrextendrrrh)r>r}rrr` gcloud_formats r%get_gcloud_command_minus_global_flags4CommandMapping.get_gcloud_command_minus_global_flagss(!% 3 3 8 8 :N ,,Y7m m_ % !7!78H!IJ I&J' r) rqr_rcrar`rdrhrgr^rerfrb)NNNNNNTFr<)r(r)r*r+r,rrrr6r2r3r4rr?propertyrrSr{rr rrr-r'rrr\r\s>8<(,&*488< !A!A!A!3i A! "${"34 A! ! A!smA!01A!45A!-5 -A!A!A!F T#{"23 #  sm   ;# ;3 ;BS,,-B C# #$B#' "#"S#X"3- "  Cy ""rr\c\rSrSrSrS\\S\\4Sjr\ S\ \ \ \ \444Sj5r \ S\ \ \44Sj5r S \ \ \4S\ \ \44S jrS \ S \ S\4S jrSS \ S \ S \ \ \ 4S\ \ \ 4S\\ S\\ 4 SjjrSrg)GcloudCommandGeneratori8z-Generates a gcloud command from a bq command.command_mappingsglobal_flag_mappingsc8XlX lSUlSUlgr<)_command_mapping_list_global_flag_mapping_list _command_dict_global_flag_dict)r>rrs rr?GcloudCommandGenerator.__init__;s "2%9"IMD?CDrr ctUR(d0UlURHnURUR;a0URUR'URURnURU;a[ SUR35eXUR'M UR$)zEReturns the commands as a map of resource to bq command to delegator.zDuplicate bq command: )rrr^r_rV)r>command_mappingresource_to_commandss r command_dict#GcloudCommandGenerator.command_dictEs   d!77/  # #4+=+= =9;$  _55 6#11/2J2JK  % %)= =&'A'A&BC  rtrXs rglobal_flag_dict'GcloudCommandGenerator.global_flag_dictUsi  ! !!d88,&& ,, ,0 :; ;*6w' 9  ! !!rbq_global_flagsc.[URU5$)auReturns the equivalent gcloud global flags for a set of bq flags. In the Args and Returns below, this `GcloudCommandGenerator` is used: GcloudCommandGenerator( command_mappings=[], global_flag_mappings=[ FlagMapping( bq_name='project_id', gcloud_name='project'), FlagMapping( bq_name='httplib2_debuglevel', gcloud_name='log-http', lambda x: x > 0) ]) Args: bq_global_flags: The bq flags that will be mapped. For example, {'project_id': 'my_project', 'httplib2_debuglevel': 1} Returns: The equivalent gcloud flags. For example, {'project': 'my_project', 'log-http': True} )rZr)r>rs rmap_to_gcloud_global_flags1GcloudCommandGenerator.map_to_gcloud_global_flags`s4 $D$9$9? KKrr^r_c&URUU$)zCReturns the gcloud delegator for the given resource and bq command.)r)r>r^r_s rget_command_mapping*GcloudCommandGenerator.get_command_mapping|s   X &z 22rNrrcURX5nU(d[SU35eUR5nURSS5n[ UR U55n U UR UUUS9-$)a$Returns the gcloud command to use for the given bq command. As an example usage: GcloudCommandGenerator( command_mappings=[CommandMapping( resource='datasets', bq_command='ls', gcloud_command=['alpha', 'bq', 'datasets', 'list'], flag_mapping_list=[ FlagMapping( bq_name='max_results', gcloud_name='limit', ), ], flag_mappings=[ FlagMapping( bq_name='project_id', gcloud_name='project'), ]).get_gcloud_command( resource='datasets', bq_command='ls', bq_global_flags={'project_id': 'bigquery-cli-e2e', 'format': 'pretty'}, bq_command_flags={'max_results': 5}, ) Will return: ['--project=bigquery-cli-e2e', 'alpha', 'bq', 'datasets', 'list', '--format=json', '--limit=5'] Args: resource: The resource the command is being run on, named to align with `gcloud` commands. For example, 'jobs' or 'datasets'. bq_command: The bq command to run. For example, 'ls' or 'show'. bq_global_flags: The BQ CLI global flags for the command. bq_command_flags: The BQ CLI command flags for the command. identifier: The identifier of the resource to act on. Returns: The gcloud command to run as an array of strings, minus the leading 'gcloud'. This can be parsed directly into `gcloud_runner.run_gcloud_command`. zUnsupported bq command: formatr)r}rr)rrVrpoprrr) r>r^r_rrr delegatorfiltered_global_flagsr}gcloud_global_flagss rget_gcloud_command)GcloudCommandGenerator.get_gcloud_commandsh((>I  1*> ??,002%))(H=I%= ''(=>&   9 9-! :  r)rrrrr<)r(r)r*r+r,rr\r6r?rrrrrr rrrrr-r'rrrr8s15D^,D!-D  Dd3+>&?!?@    "S+%5 6" "L!#'9"9:L C# #$L833'*33#' HHHCH~ H S#X H 3- H CyHHrr)r,collections.abcrsystypingrrrrtyping_extensionsrrrrCr __annotations__r rr# Exceptionr% version_infor1r2r3r4r6rFrZr\rr'rrrsO$ ..' %c4n 5I5U3+?%@ @A yA s../  #Y  T#Y 49 B B y )1..*Y$,hsm$m3$y&.sCos.B%CC#+SE4K#8y8)1Y1#+y+%--#+y+# # L P[ P[()3**+ #! !"6hhVSSr