SrSSKJr SSKJr SSKJr SSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK r SSK JrJrJrJrJrJrJr SSKJr SSKJr SSKrSSKrSSKrSS KJr SS KJr SS KJ r SS KJ!r! SS KJ"r" SSKJ#r# SSK$J%r% \ RLS:a SSK'J(r(J)r) OSSK J(r(J)r) \RTr*Sr+\ RX"S5r-\ RX"S5r.Sr/Sr0Sr1Sr2SSS.r3SSSSSS .r4S!r5S"\S#\64S$jr7S"\S#\64S%jr8S&\9S'\9S#\\\44S(jr:S)r;S*\9S#\94S+jrS.\9S#\94S/jr?S0r@S1\\9S#\\9\944S2jrAS3\9S#\64S4jrBS3\9S#\\\9\944S5jrC"S6S7\D5rESmS8jrFSnS9jrGS:\9S#\\\9\44S;jrHS<\\9\4S=\9S#\\9\44S>jrIS<\\9\4S=\9S#\\9\44S?jrJS@rKSoSAjrLSpSBjrMSpSC\\9S#\\\9\\944SDjjrNSpSE\\9S#\\94SFjjrOSpSGjrPSH\9S#\64SIjrQSJ\9SK\9S#\\94SLjrRSMrSSNrTSqSO\#RRSP\!RSQ\6S#S4SRjjrXSSrY"STSU\(5rZSV\\SW\\#RRSX\"SYSZ\64S[\64/5S\\\ZS#S4 S]jr[S^r\S_\9S#S4S`jr]Sar^Sbr_Scr`SdraSerbSfrcSgrdSh\R S#\94SijreSj\9S#\\9\944SkjrfSlrgg)rz,Python script for interacting with BigQuery.)absolute_import)division)print_functionN)AnyDictList NamedTupleOptionalTupleType)app)flags)utils) utils_flags)utils_formatting) bq_consts)bq_error) bq_id_utils) stringutil) ) TypedDict NotRequiredaUse schema inference specifically for Parquet LIST logical type. It checks whether the LIST node is in the standard form as documented in: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#lists group (LIST) { repeated group list { element; } } Returns the "element" node in list_element_node. The corresponding field for the LIST node in the converted schema is treated as if the node has the following schema: repeated This means nodes "list" and "element" are omitted. Otherwise, the LIST node must be in one of the forms described by the backward-compatibility rules as documented in: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#backward-compatibility-rules group (LIST) { repeated } Returns the node in list_element_node. The corresponding field for the LIST node in the converted schema is treated as if the node has the following schema: repeated This means the element node is omitted.z[\w-]+z^\[(\S+.+\S+), (\S+.+\S+)\)$ parametersdefaultStorageLocationUristorageDescriptor connectionId )tabz\tSkippedCreatedReplacedAlteredDropped)SKIPCREATEREPLACEALTERDROPc[R(a,[R(a[R"S5egg)z,Validate combinations of global flag values.zDCannot specify both --service_account and --use_gce_service_account.N)FLAGSservice_accountuse_gce_service_accountr UsageErrorplatform/bq/frontend/utils.pyValidateGlobalFlagsr2Rs/ u<< ..N  =r0argsreturnc>SnUHnU(dM US- nM US:$)zValidates that at most one of the argument flags is selected. Args: *args: Each flag to be tested parsed in as a separate arg. Returns: True if more than 1 flag was selected, False if 1 or 0 were selected. rr/r3countargs r1ValidateAtMostOneSelectedr:Zs- % c s qje r0cjSnUH'nU(dM [U5"5U:wdM"US- nM) US:$)aValidates that at most one of the argument flags is selected. if the arg exists but the value is the default value, then it won't be counted. This is uself when users want to clear the value while setting another value. For example, 'update --arg1=0 --arg2=100' when arg1 and arg2 shouldn't coexist. Args: *args: Each flag to be tested parsed in as a separate arg. Returns: True if more than 1 flag was selected, False if 1 or 0 were selected. rr6)typer7s r1&ValidateAtMostOneSelectedAllowsDefaultr=js: % c stCy{c! qje r0 descriptionsourcecDSnUcX4$[RRU5(d[R"SU<35e[RR U5(d[R"SU<35e[ U5n[R"U5nSU;aUSn[R"S5 SU;aUSnSSS5 X4$![a#n[R"SU<SU<35eSnAff=f!,(df  X4$=f) afProcess "source" parameter used for bq update and bq mk command. Args: description: Description of the dataset. source: source file path attached by "--source" parameter. Returns: new description if the source file updates the description, otherwise return the original description. acl if the source file updates the acl, otherwise return None. NzSource file not found: zSource path is not a file: r>zPBoth source file and description flag exist, using the value in the source file.accessz%Error decoding JSON schema from file : ) ospathexistsr r.isfileopenjsonloadloggingdebug ValueError)r>r?aclfpayloades r1 ProcessSourcerQs # ^      ..@ AA    ..FD EE F|q  ! g ' !m,     W h    NN;A1 E |  s+DAC D )DD  D Dc[RS;a[R"U5 gSUSS;a [ S5 gUSSSnUSSR SS5n[RS :Xa [ U5 gUSSR S S 5S :Xa-[ S USSSS<SUSSSS<S35 gUS:Xa[ SU<S35 gUS:Xa[ SU<S35 gUS:Xa[ SU<S35 gUSSS S:Xa [ S5 g[ SU<S35 g)zPrints the dry run info. prettyjsonrHNtotalBytesProcessed statisticsqueryzQuery successfully validated. No information about number of bytes processed. To see the full details of the job, run this query with `--format=json` or `--format=prettyjson`.totalBytesProcessedAccuracyPRECISEcsv statementType LOAD_DATAzcQuery successfully validated. Assuming the files are not modified, running this query will process loadQueryStatistics inputFilesz files loading inputFileBytesz bytes of data.zdQuery successfully validated. Assuming the tables are not modified, running this query will process LOWER_BOUNDzsQuery successfully validated. Assuming the tables are not modified, running this query will process lower bound of UPPER_BOUNDzsQuery successfully validated. Assuming the tables are not modified, running this query will process upper bound of CREATE_MODELzQuery successfully validated. The number of bytes that will be processed by this query cannot be calculated automatically. More information about this can be seen in https://cloud.google.com/bigquery-ml/pricing#dry_runzU of data and the accuracy is unknown because of federated tables or clustered tables.)r+formatbq_utilsPrintFormattedJsonObjectprintget)job num_bytesnum_bytes_accuracys r1PrintDryRunInforls \\++ %%c* #l"3G"<<  5  ,()>?)<(155#Y \\U ) <!%%or:kI ,()>? M,()>?"    y ( AJ M } ,   } ,   \ 7 #O 4 F  C  # % r0messagec[U5$![aS [RR 5(a [ S5 O [ S5 [R "S5 gf=f)Nz Got EOF; exiting.z1 Got EOF; exiting. Is your input from a terminal?r6)inputEOFErrorsysstdinisattyrgexitrms r1RawInputrvsP >  yy !" @AHHQK s AA*)A*c~[R(a[SU<35 g[U5R 5$)z=Prompts user with message, return key pressed or '' on enter.z2Running --headless, accepting default for prompt: r\)r+headlessrgrvlowerrus r1PromptWithDefaultrzs+ ^^ G MN '  ""r0c<SnUS;a[U5nUS;aMU$)zFPrompts user with message, returning the key 'y', 'n', or '' on enter.N)ynr\)rz)rmresponses r1PromptYNrs( (& )H & /r0field_delimitercVUcU$UR5n[RX5$)z2Validates and returns the correct field_delimiter.)ry_DELIMITER_MAPrh)rkeys r1NormalizeFieldDelimiterrs1  #   C 11r0c<US;a[R"S5eg)aValidates the string provided is one the API accepts. Should not receive None as an input, since that will fail the comparison. Args: hive_partitioning_mode: String representing which hive partitioning mode is requested. Only 'AUTO' and 'STRINGS' are supported. )AUTOSTRINGSCUSTOMzXOnly the following hive partitioning modes are supported: "AUTO", "STRINGS" and "CUSTOM"Nr r.)hive_partitioning_modes r1ValidateHivePartitioningOptionsrs)#@@ .. ! Ar0labelsc0nUH|nURS5up4nUR5nX1;a[R"SU-5eUR5(dM\UR5XR5'M~ U$)a.Parses a list of user-supplied strings representing labels. Args: labels: A list of user-supplied strings representing labels. It is expected to be in the format "key:value". Returns: A dict mapping label keys to label values. Raises: UsageError: Incorrect label arguments were supplied. :z,Cannot specify label key "%s" multiple times) partitionstripr r.)r labels_dict key_valuek_vs r1 ParseLabelsrst+i!!#&GA!  A NNIAM NNwwyy wwyk'')  r0valuec\UR5S:H=(d UR5S:H$)N UNBOUNDEDNULL)upperrs r1IsRangeBoundaryUnboundedr5s# + % @&)@@r0cf[RU5nU(dgUR5up#X#4$N)_RANGE_PATTERNmatchgroups)rrstartends r1ParseRangeStringr9s-   u %%  ||~*% r0c^\rSrSrSrU4Sjr\S5r\S5r\S5r \S5r \S\ 4S j5r \S\ 4S j5r \S 5r\S\ 4S j5rS\ 4S jrSrU=r$) TablePrinteriAz?Base class for printing a table, with a default implementation.c t>[[U] 5 UR5Hup#[ XU5 M gr)superr__init__itemssetattr)selfkwdsrr __class__s r1rTablePrinter.__init__Ds, ,&(jjl  d#r0c<[U[R5(a}UHvnUSR5S:Xa[R "SUS-5eUR SS5R5S:XdM\[R "SUS-5e gg) Nr<RECORDzCError printing table: Cannot print record field "%s" in CSV format.namemodeNULLABLEREPEATEDzEError printing table: Cannot print repeated field "%s" in CSV format.) isinstancetable_formatter CsvFormatterrr r.rh)fields formatterfields r1_ValidateFieldsTablePrinter._ValidateFieldsJs)_99::% =   H ,.f    99VZ ( . . 0J >.v    ;r0c[R"5n[URS/5U5H-upE[R XEU5X4RSS5'M/ U$)z0Returns bq-specific formatting of a RECORD type.rrr\) collections OrderedDictziprhrNormalizeField)rruse_full_timestampresultsubfieldsubvalues r1_NormalizeRecordTablePrinter._NormalizeRecord_s] $ $ &F!%))Hb"95A)5)D)D 0*f\\&" %&B Mr0cHU(aU$[RRS[RRS9[R"[ U5S9-nUR SS9nUR SS9nURS5$![[4a gf=f) z3Returns bq-specific formatting of a TIMESTAMP type.r)tz)secondsN)tzinfo) microsecond z) datetime fromtimestamptimezoneutc timedeltafloatreplace isoformatrL OverflowError) unused_fieldrrdates r1_NormalizeTimestamp TablePrinter._NormalizeTimestampis/    .. (##''/   uU| 45||4|(|||*~~c""  &/ ./sBBBB! B!c[U5nUcgUupEURS5RS5R5S:waO[U5(aUR5OUn[U5(aUR5OUnSU<SU<S3$[U5(aUR5nO[R XU5n[U5(aUR5nO[R XU5nSU<SU<S3$)z/Returns bq-specific formatting of a RANGE type.zrangeElementTyper< TIMESTAMP[, ))rrhrrrr)rrrparsedrrnormalized_startnormalized_ends r1_NormalizeRangeTablePrinter._NormalizeRange}se $F ~ JE yy#$((0668KG7>>ekkmEe3C88CIIKcc # &&&&%99 * $$yy{n#77 (n*> ::r0rcUcgURSS5R5S:Xa'UVs/sHn[RXU5PM sn$[RXU5$s snf)z*Returns bq-specific formatting of a field.Nrr\r)rhrr_NormalizeSingleValuerrrs r1rTablePrinter.NormalizeFieldss }  yy""$ 2e  , ,U;M N  - -e!> ? ?<22F;f)_99::# UHn[RTUTT5v M g7fr)rr).0rrrrs r1 *TablePrinter.PrintTable..s-C vsI7IJJs%()rget_formatter_from_flagsr AddFieldsAddRowsPrint)rrrowsrrs ` `@r1 PrintTableTablePrinter.PrintTablesX44hOI+  OOr0r/)__name__ __module__ __qualname____firstlineno____doc__r staticmethodrrrrboolrrrrr __static_attributes__ __classcell__)rs@r1rrAsG   (//&;;4 Pt P Pd D r0rc/SQnUU;a[R"SU-5eSU0nUbUUS'U bU US'UbUUS'UbUUS'UbUUS 'UbUUS 'UbUUS 'U b-S S /nU U;a[R"SU -5eSUS'U US'UbUUS'USS:Xa{U(aSUS'[R"S5US'O[R"S5US'UUSS'U=(d SUSS'UbUUSS'UbUUSS'UbUUSS'GO,USS:Xa!UbU(aSUS'SU=(d S0US'GOUSS:Xa*UbU(aSUS'O[R"S 5US!'OUSS":XaS#U 0US$'UbUUS%'OUSS&:XaU U US'.US('UbUUS%'OUSS):Xa UbUUS%'OUSS*:Xd USS+:XawUSS*:XaS,OS-nUbU(aU(a"S.U<S/35eSUS'[ UR S055S1:wa"S2U<S335eU(aSUS4'Ub+[ U5 0nUUS5'UbUUS6'UUS7'U(aSUS8'U(a[R"U5n S9U 0US:'U(aUUS;'UR S05US<'U$![an![R"S=U!-5eSn!A!ff=f)>aCreates an external table definition with the given URIs and the schema. Arguments: source_format: Format of source data. For CSV files, specify 'CSV'. For Google spreadsheet files, specify 'GOOGLE_SHEETS'. For newline-delimited JSON, specify 'NEWLINE_DELIMITED_JSON'. For Cloud Datastore backup, specify 'DATASTORE_BACKUP'. For Avro files, specify 'AVRO'. For Orc files, specify 'ORC'. For Parquet files, specify 'PARQUET'. For Iceberg tables, specify 'ICEBERG'. source_uris: Comma separated list of URIs that contain data for this table. schema: Either an inline schema or path to a schema file. autodetect: Indicates if format options, compression mode and schema be auto detected from the source data. True - means that autodetect is on, False means that it is off. None means format specific default: - For CSV it means autodetect is OFF - For JSON it means that autodetect is ON. For JSON, defaulting to autodetection is safer because the only option autodetected is compression. If a schema is passed, then the user-supplied schema is used. connection_id: The user flag with the same name defined for the _Load BigqueryCmd ignore_unknown_values: Indicates if BigQuery should allow extra values that are not represented in the table schema. If true, the extra values are ignored. If false, records with extra columns are treated as bad records, and if there are too many bad records, an invalid error is returned in the job result. The default value is false. The sourceFormat property determines what BigQuery treats as an extra value: - CSV: Trailing columns - JSON: Named values that don't match any column names. hive_partitioning_mode: Enables hive partitioning. AUTO indicates to perform automatic type inference. STRINGS indicates to treat all hive partition keys as STRING typed. No other values are accepted. hive_partitioning_source_uri_prefix: Shared prefix for all files until hive partitioning encoding begins. require_hive_partition_filter: The user flag with the same name defined for the _Load BigqueryCmd use_avro_logical_types: The user flag with the same name defined for the _Load BigqueryCmd parquet_enum_as_string: The user flag with the same name defined for the _Load BigqueryCmd parquet_enable_list_inference: The user flag with the same name defined for the _Load BigqueryCmd metadata_cache_mode: Enables metadata cache for an external table with a connection. Specify 'AUTOMATIC' to automatically refresh the cached metadata. Specify 'MANUAL' to stop the automatic refresh. object_metadata: Object Metadata Type. preserve_ascii_control_characters: The user flag with the same name defined for the _Load BigqueryCmd reference_file_schema_uri: The user flag with the same name defined for the _Load BigqueryCmd encoding: Encoding types for CSV files. Available options are: 'UTF-8', 'ISO-8859-1', 'UTF-16BE', 'UTF-16LE', 'UTF-32BE', and 'UTF-32LE'. The default value is 'UTF-8'. file_set_spec_type: Set how to discover files given source URIs. Specify 'FILE_SYSTEM_MATCH' (default behavior) to expand source URIs by listing files from the underlying object store. Specify 'NEW_LINE_DELIMITED_MANIFEST' to parse the URIs as new line delimited manifest files, where each line contains a URI (No wild-card URIs are supported). null_marker: Specifies a string that represents a null value in a CSV file. null_markers: Specifies a list of strings that represent null values in a CSV file. time_zone: Specifies the time zone for a CSV or JSON file. date_format: Specifies the date format for a CSV or JSON file. datetime_format: Specifies the datetime format for a CSV or JSON file. time_format: Specifies the time format for a CSV or JSON file. timestamp_format: Specifies the timestamp format for a CSV or JSON file. source_column_match: Controls the strategy used to match loaded columns to the schema. parquet_map_target_type: Indicate the target type for parquet maps. If unspecified, we represent parquet maps as map {repeated key_value {key, value}}. This option can simplify this by omiting the key_value record if it's equal to ARRAY_OF_STRUCT. timestamp_target_precision: Precision (maximum number of total digits in base 10) for seconds of TIMESTAMP type. Returns: A python dictionary that contains a external table definition for the given format with the most common options set. ) CSVNEWLINE_DELIMITED_JSONDATASTORE_BACKUP DELTA_LAKEAVROORCPARQUET GOOGLE_SHEETSICEBERGz%s is not a supported format. sourceFormatNfileSetSpecTypemetadataCacheModetimeZone dateFormatdatetimeFormat timeFormattimestampFormat DIRECTORYSIMPLEz+%s is not a supported Object Metadata Type.objectMetadatatimestampTargetPrecisionrT autodetectzg { "quote": '"', "encoding": "UTF-8" } csvOptionsa  { "allowJaggedRows": false, "fieldDelimiter": ",", "allowQuotedNewlines": false, "quote": '"', "skipLeadingRows": 0, "encoding": "UTF-8" } preserveAsciiControlCharacterszUTF-8encoding nullMarker nullMarkerssourceColumnMatchr jsonOptionsrzJ { "skipLeadingRows": 0 } googleSheetsOptionsruseAvroLogicalTypes avroOptionsreferenceFileSchemaUrir) enumAsStringenableListInference mapTargetTypeparquetOptionsrr rIcebergz Delta LakezCannot create z" table from user-specified schema.rr6z%Must provide only one source_uri for z table.ignoreUnknownValuesrsourceUriPrefixhivePartitioningOptionsrequirePartitionFilterrschemar sourceUrisz2Error occurred while creating table definition: %s) r r.yaml safe_loadlensplitrbq_client_utils ReadSchemarL)" source_format source_urisrBr- connection_idignore_unknown_valuesr#hive_partitioning_source_uri_prefixrequire_hive_partition_filteruse_avro_logical_typesparquet_enum_as_stringparquet_enable_list_inferencemetadata_cache_modeobject_metadata!preserve_ascii_control_charactersreference_file_schema_urir0file_set_spec_type null_marker null_markers time_zone date_formatdatetime_format time_formattimestamp_formatsource_column_matchparquet_map_target_typetimestamp_target_precisionsupported_formatsexternal_table_defsupported_obj_metadata_typeshive_partitioning_optionsrrPs" r1CreateExternalTableDefinitionrfsQX^ -- NN:]J KK(-8%.@*+&0C,-'0$)4&"-<)*)4&#.>*+"&18%<"  < <nn 9O K  ,0(-<)*!-7Q34.)U2 +/<(+/>>; , <(,0>> ; , <( ,& *6>5H&z2  9D<(6  !:F<(7  (  <(   N +/G G  z+/<(+5x7J7*K' N + >  z+/<(48NND 5 01 N +v 5 !7+' # .7P34 N +y 80!>2.)* # .7P34 N +u 4 " .7P34>*i7 n - =  /9 <    fnn   *.& [  s # $ )nn@M O  26./)%&<="$*@' , 8 / ""347P23 &>B!":; ))&1f&.%7"+8('2'8'8'=|$   ../ s  ::   NN Q  s6 F,F& F, F)%F,)F,,G- G((G-file_path_or_json_stringc@[RRU5n[RRU5(a,[ U5n[ R "U5sSSS5 $[ R"U5$!,(df  g=f![ RRa#n[R"SU<SU<35eSnAff=f![ RRa#n[R"SU<SU<35eSnAff=f)aReturns a JSON object from the file or a JSON string. Determines if the input string is a file path or a string, then returns either the parsed file contents, or the parsed JSON from string. The file content is expected to be a JSON string. Args: file_path_or_json_string: Path to the JSON file or a JSON string. Raises: UsageError: when incorrect usage or invalid args are used. NzError decoding JSON from file rBz Error decoding JSON from string ) rCrDrkrFrGrHrIdecoderJSONDecodeErrorr r.loads)rxrp json_filerPs r1GetJsonr~Xs77%%&>?.WW^^N##  9yy#  ZZ0 11  << ' ' NN4BA F  << ' ' NN %q * sN BB& B1C BBBC6CCD:DDcurrent_optionsexternal_options_strc0UR[5b!U[Vs0sHo"S_M snU['UR[5b!U[Vs0sHo"S_M snU['[U5n[U;a6UR [05 U[R U[5 O SU['[U;aU[U['O SU['[ U;aU[ U[ 'U$SU[ 'U$s snfs snf)aUpdates the external catalog table options. Args: current_options: The current external catalog table options. external_options_str: The new external catalog table options as a JSON string or a file path. Returns: The updated external catalog table options. N)rh_PARAMETERS_KEY_STORAGE_DESCRIPTOR_KEYr~ setdefaultupdate_CONNECTION_ID_KEY)rrr#external_catalog_table_options_dicts r1!UpdateExternalCatalogTableOptionsrzs0 )5(9(9A49(OO$ 01=()@A0AA4A0O+,)00D(E%;;3O$+++O<(,OO$ CC+,CD+,04O+,>>*M+O&' +/O&' =( 0s D DcUR[5b!U[Vs0sHo"S_M snU['[U5n[U;aBUR[05 U[R 5HupEXP[U'M O SU['[ U;aU[ U[ 'U$SU[ 'U$s snf)aUpdates the external catalog dataset options. Args: current_options: The current external catalog dataset options. external_options_str: The new external catalog dataset options as a JSON string or a file path. Returns: The updated external catalog dataset options. N)rhrr~rr!_DEFAULT_STORAGE_LOCATION_URI_KEY)rrr%external_catalog_dataset_options_dictrrs r1#UpdateExternalCatalogDatasetOptionsrs )5(9(9A49(OO$+22F*G'==3; eg /4o&s+ (,OO$&*OO-.OP56 :>O56 %(s B?c[R"SS9n[R"U[R R 5 URU5 UR5 g)zPrints the page token in the pretty format. Args: page_token: The dictionary mapping of pageToken with string 'nextPageToken'. rrN) rrrconfigure_formatterrApiClientHelperNextPageTokenReferenceAddDictr ) page_tokenrs r1PrintPageTokenrsM 22HM)&&,,CC J //r0c0nSnSnSnSn Sn UbXU'UbUS-XW'UbX%U'UbUbUXY'O[R"S5eUb U(aUXZ'U(aXe;aS XV'Xu;a XWS ::aSXW'U$g) aParses time partitioning from the arguments. Args: partitioning_type: type for the time partitioning. Supported types are HOUR, DAY, MONTH, and YEAR. The default value is DAY when other arguments are specified, which generates one partition per day. partitioning_expiration: number of seconds to keep the storage for a partition. A negative value clears this setting. partitioning_field: if not set, the table is partitioned based on the loading time; if set, the table is partitioned based on the value of this field. partitioning_minimum_partition_date: lower boundary of partition date for field based partitioning table. partitioning_require_partition_filter: if true, queries on the table must have a partition filter so not all partitions are scanned. Returns: Time partitioning if any of the arguments is not None, otherwise None. Raises: UsageError: when failed to parse. r< expirationMsrminimumPartitionDaterANizYNeed to specify --time_partitioning_field for --time_partitioning_minimum_partition_date.DAYrr) partitioning_typepartitioning_expirationpartitioning_field#partitioning_minimum_partition_date%partitioning_require_partition_filtertime_partitioningkey_typekey_expiration key_fieldkey_minimum_partition_datekey_require_partition_filters r1ParseTimePartitioningrs< (!.)5!9""3h((?$(F%##5i (4% -3 NN 8 +6 /5($)!+  - 2*.'  r0cRUcgSS/nX;a[R"S5eSU-$)zParses the file set specification type from the arguments. Args: file_set_spec_type: specifies how to discover files given source URIs. Returns: file set specification type. Raises: UsageError: when an illegal value is passed. NFILE_SYSTEM_MATCHNEW_LINE_DELIMITED_MANIFESTznError parsing file_set_spec_type, only FILE_SYSTEM_MATCH, NEW_LINE_DELIMITED_MANIFEST or no value are acceptedFILE_SET_SPEC_TYPE_r)rWvalid_spec_typess r1ParseFileSetSpecTyper'sC )+HI/ .. ?  !3 33r0clustering_fieldsc@US:Xa0$UbSURS50$g)a~Parses clustering from the arguments. Args: clustering_fields: Comma-separated field names. Returns: Clustering if any of the arguments is not None, otherwise None. Special case if clustering_fields is passed in as an empty string instead of None, in which case we'll return {}, to support the scenario where user wants to update a table and remove the clustering spec. r\Nrr)rG)rs r1ParseClusteringr=s1" I$ '--c2 33 r0numeric_type_conversion_modecDUcgUS:Xag[R"S5e)a Parses the numeric type conversion mode from the arguments. Args: numeric_type_conversion_mode: specifies how the numeric values are handled when the value is out of scale. Returns: The conversion mode. Raises: UsageError: when an illegal value is passed. NROUNDNUMERIC_TYPE_VALUE_ROUNDzOError parsing numeric_type_conversion_mode, only ROUND or no value are acceptedr)rs r1ParseNumericTypeConversionModerTs. ") #w. % ..  r0c0nSnSnSnSnSnUbXURS5n[U5S:wa[R"S 5eUS X'0nUS X'US X'US X'XU'U(aU$g)a/Parses range partitioning from the arguments. Args: range_partitioning_spec: specification for range partitioning in the format of field,start,end,interval. Returns: Range partitioning if range_partitioning_spec is not None, otherwise None. Raises: UsageError: when the spec fails to parse. rrangerrintervalNrzjError parsing range_partitioning. range_partitioning should be in the format of "field,start,end,interval"rr6rirrGrFr r.) range_partitioning_specrange_partitioningr key_rangekey_range_start key_range_endkey_range_intervalrs range_specs r1ParseRangePartitioningros))/-!( # ) )# .E 5zQ NN 5 %*!H!J"'(J %aJ%*1XJ"$.y!  r0printable_job_infoc$SU;=(d SU;$)zBReturns True iff the job is successful and is a DML/DDL query job. Affected RowsDDL Operation Performedr/)rs r1IsSuccessfulDmlOrDdlJobrs ++9 "&8 8r0 dataset_id object_idc[R"SU5(dgSnSn[R"US-U-U5nU(dgURS5$)avIf we have a session temporary object, returns the user name of the object. Args: dataset_id: Dataset of object object_id: Id of object Returns: If the object is a session temp object, the name of the object after stripping out internal stuff such as session prefix and signature encodings. If the object is not a session temp object, the return value is None. z _[0-9a-f]{40}Nz>_[0-9a-f]{8}_[0-9a-f]{4}_[0-9a-f]{4}_[0-9a-f]{4}_[0-9a-f]{12}_z(?:_b0a98f6_.*)?z(.*?)r6)re fullmatchgroup)rrsession_prefix_regexpopt_signature_encoding_regexprs r1MaybeGetSessionTempObjectNamers_ oz 2 2 G#5 ,,g%(EEy %   Qr0c@[U5nU(a [U5 gg)aaPrints additional info from a job formatted for printing. If the job had a fatal error, non-fatal warnings are not shown. If any error/warning does not have a 'message' key, printable_job_info must have 'jobReference' identifying the job. For DML queries prints number of affected rows. For DDL queries prints the performed operation and the target. N)GetJobMessagesForPrintingrg)rmessagess r1PrintJobMessagesrs''9 :(  (Or0c  /nSnSU;aUSnUSS:XaLUSSnUSRS/5n[R"X3U5nURSU<S 35 GOZSUS;aUSSnURS [ U5S :XaS OS -5 SnUHQnSU;aSnM SU;aSUS<SUS<3n OUSn U bU R S5n URSU -5 MS U(aURSU-5 GOSU;aURSUS-5 GOSU;Ga USn U RS5n U RS5n U RS5n [ RURS55nU (GaU (GaU (GaU(GaSU;a)USnURSRUUU U U S 95 GOS!U;Ga;S"US!;Ga1S#US!;asUR[R"U5<S$[R"U 5<S%[R"U 5<S%[R"U 5<S 35 GOPS&US!;aS nURS5S';a S(U <S%U <S)3nUR[R"U5<S*[R"U 5<S%[R"U 5<S%[R"U 5<S [R"U5<3 5 GOUR[R"U5<S+[R"U 5<S%[R"U 5<S%[R"U 5<S 35 S,U;aUS,nUSnS-U;aUS!S.:XaS/nOS0nURS1[R"U5<S2[R"U 5<S3[R"U 5<S4[R"U5<S53 5 S6U;aURS75 GO{S8U;aUS8nURS5n URS5n URS95n[ RURS55n[U U5nUbURU<S:U<35 OURU<S+U <S%U <S%U<35 OS;U;aUS;nURS5n URS5n URS5n URS<5n[ RURS55nU (a>U (a7U (a0U(a)U(a"URS=RUUU U U S>95 OS?U;aURS@5 SAU;aURSBUSA-5 S RU5$)CzKSimilar to _PrintJobMessages(), but returns a string, rather than printing.z (unknown) jobReferenceStateFAILUREstatus errorResulterrorsz(Error encountered during job execution:  z,Warning%s encountered during job execution: r6r\sFrmTlocationrz] zutf-8z%s z)Use "bq show -j %s" to view job warnings.rzNumber of affected rows: %s zDDL Target Table projectId datasetIdtableIdrz$DDL Affected Row Access Policy CountzF{op} {count} row access policies on table {project}.{dataset}.{table} )opr8projectdatasettablezStatement TypeINDEX SEARCH_INDEXz search index on table . VECTOR_INDEX)r&r'z Please query z9.INFORMATION_SCHEMA to check the progress of the index. z vector index on table rzDefault Connection Stats provisionedrcmodelrzDefault connection created for z [z] in project [z ] in region [z] permissionUpdatedzL!(+//"=H  ( (X NE;@B%h//!(+H5H7X!#2 .N  !  ?!":) ='iL'  NN7+'FW,-EOP,,'*<_*MM//)*<=!%%k2J!%%k2J##I.H   89 B jX" /3E E/A 20 ,  ,,2F:"" -3-  0 0+,<== /0@A A   ''+'' 3'' 3''1  12BC C') $  # #$= >C  Z*) &   ''+'' 3'' 3''1''(BC   %%b)%%j1%%j1%%h/    &); ;%7(& " ++ 6 6!"23~E#k#k   ))+6))(3))*5))+6  !$< <   O 11+,@A#'' 4J#'' 4J#'' 4J   89 B5ZL#r;KLMz:z B&);;#5&$ .11+>J-11+>J+// :H7;;JG   89 BjX2F2 P 6)     ((./''(+=l+KKL <  r0 reference custom_formatprint_referencecUS:XaBSU;d SUS;a[R"S5e[R"USS5 g [R S;a[R"U5 g [R S;Ga[ R"5n[R"U[U5UUS9 [R"U[U55nU(aURU5 UR(a2U(a+[URR5<SU<S35 UR!5 [5 [#U[$R&R(5(a [+U5 g g [ R"5nUR-[/UR1555 URU5 UR!5 g ) z'Prints the object with various formats.rBrz/Unable to retrieve schema from specified table.rSNsparser) print_format object_inforrN)r r.rerfr+rdrrrrr<format_info_by_typertypenamerg capitalizer rrr JobReferencer AddColumnsrkeys)rrrr rs r1PrintObjectInforskh{"hk(6K&K NNL MM %%k(&;H&EF ||-- %%k2 ||11446I(( Y"  #66T)_K $o ++668) DE OO G)[88EEFF{#G446I k..012 k" OOr0c [RS;a[R"U5 g[RS;aU(dg[R "5n[ R"X!SS9 [[[R"[ RUS9U55nUHnURU5 M UR5 gU(ak[R "5nUR[USR!555 UHnURU5 M UR5 gg)NrSr r)r ) object_typer)r+rdrerfrrrrrr functoolspartialrrr rr) object_infos objects_typerformatted_infosinfos r1PrintObjectsArrayrs \\++ %%l3 ||11  446I((f    44(    O   OO446I l1o22456 OO r0cD\rSrSr%Sr\\\S'Sr\\ \\S'Sr g)ResourceMetadataiNtoken unreachabler/) rrrrr!rstr__annotations__r"rrr/r0r1r r s$ %S  (,+{49%,r0r  objects_listr passed_flags PassedFlagsprint_last_tokenprint_unreachableobjects_metadatac2[RS;a~UR(dUR(aCSU0nUR(aSU;aUSUS'UR(aSU;aUSUS'OUn[R "U5 g[RS;aq[ X5 UcgUR(aSU;a[SUS-5 UR(a(SU;a![SS RUS5-5 gggg) aPrints the objects array with metadata configured to print using flags. If there is no `objects_metadata` passed in, then this function has the same behaviour as `PrintObjectsArray`. Different metadata can be printed by setting flags in `passed_flags`. With a `format` of 'sparse' or 'pretty' then nothing will be printed if no flags are set. With a format of 'prettyjson' or 'json' then the `objects_list` will be printed as a `results` value even if no flags are set to print metadata but if some are set, these will also be printed. Arguments: objects_list: The list of resources to print. objects_type: The type of the resources to be printed. passed_flags: Flags used to configure the printing behaviour. objects_metadata: Optional metadata to be printed. rSresultsr!r"r Nz Next token: z Unreachable: r) r+rdr(r)rerfrrgr)r%rr&r* json_objects r1PrintObjectsArrayWithMetadatar.s: \\++$$ (F(F -k  & &76F+F/8 G  ' 'M=M,M%5m%D M" k %%k2 ||11l1 $$4D)D /8 89%%-;K*K  *:=*I J JK+L% 2r0c8Ucg/n/nUHnURS5Hn[RRU5(a5[ U5nUR UR 55 SSS5 M\URS5(d[R"S5eUR U5 M M /nU(aUHnUR SU05 M U(aUHnUR SU05 M U$!,(df  M=f)zParses UDF resources from an array of resource URIs. Arguments: udf_resources: Array of udf resource URIs. Returns: Array of UDF resources parsed into the format expected by the BigQuery API client. Nrzgs://z>Non-inline resources must be Google Cloud Storage (gs://) URIs inlineCode resourceUri) rGrCrDrFrGrread startswithr r.) udf_resourcesinline_udf_resourcesexternal_udf_resourcesurisrvudf_fileudfsudf_codes r1ParseUdfResourcesr;s dzz#    #Y(  % %hmmo 6Y~~g&&N   %%c* $( kk<*+)% kk=#&'& +Ys  D  D dataset_namecr[R"SU5nU(d[R"SU-5eg)zA regex to ensure the dataset name is valid. Arguments: dataset_name: string name of the dataset to be validated. Raises: UsageError: An error occurred due to invalid dataset string. z[a-zA-Z0-9\_]{1,1024}zvDataset name: %s is invalid, must be letters (uppercase or lowercase), numbers, and underscores up to 1024 characters.N)rrr r.)r<is_valids r1ValidateDatasetNamer?%s;\\2L A(  .. ) *  r0c*U(dg/nUHpn[RRU5(a/[U5nU[R "U5- nSSS5 MVUR [U55 Mr U$!,(df  M=f)arParses query parameters from an array of name:type:value. Arguments: parameters: An iterable of string-form query parameters: name:type:value. Name may be omitted to indicate a positional parameter: :type:value. Type may be omitted to indicate a string: name::value, or ::value. Returns: A list of query parameters in the form for the BigQuery API client. N)rCrDrFrGrHrIrParseParameter)rr, param_stringrNs r1ParseParametersrC8ss   ' l ww~~l##  499Q<  nn^L12 ! .  s B B ctURSS5n[U5S:wa[R"S5eU$)Nrr6rizQuery parameters must be of the form: "name:type:value", ":type:value", or "name::value". An empty name produces a positional parameter. An empty type produces a STRING parameter.r)rBrGs r1 SplitParamrEOs<   S! $%Z1_ .. 5  ,r0c[U5up[U5up#WWS.nU(aXS'U$![Ra3n[ SU<SU<35 [ R "S5 SnANTSnAff=f)z?Parse a string of the form : into each part.zError parsing parameter rBr6N) parameterTypeparameterValuer)rEParseParameterTypeAndValuer r.rgrqrt)rBr type_dict value_dictrPrs r1rArA[sl!,/$6|DI'* E& 6N -  dA 67HHQKKs .A5)A00A5c^[U5upU(dSn[U5nU[X254$)zCParse a string of the form : into each part.STRING)rEParseParameterTypeParseParameterValue)rB type_string value_stringrJs r1rIrIis2(6+ K -) ' @ @@r0cSUR50nUR5RS5(a'URS5(aS[USS5S.nURS5(a'URS5(aS [ US S5S .nURS 5(a'URS5(aS [USS5S.nU(d[ R "S5eU$)zDParse a parameter type string into a JSON dict for the BigQuery API.r<zARRAY<>ARRAY)r< arrayTypezSTRUCT<STRUCT)r< structTypeszRANGE*>s*C*C.{1R/@AI  ..7 88 r0cl/n[U5H"up#UR[U5US.5 M$ U$)z9Parse a Struct QueryParameter type into a JSON dict form.)r<r)StructTypeSplitrrN)rPsubtypesrsub_types r1r\r\s4 (' 4nd OO/94HI5 /r0c## U(aURSS5SnSU;auSnSn[URS5[U55H%nXS:XaUS- nXS:XaUS-nUS:XdM% O US:wa[R "S5eUSUS-nU[U5S-SnURSS5n[U5S:wa[R "S 5eUv U(aMgg7f) zyYields single field-name, sub-types tuple from a StructType string. Raises: UsageError: When a field name is missing. rr6rS  + >S  + !   <  nn788gA&ic)nq023K __T1 %F 6{a NND EE L'  sA,C12A;C1/C1 datetime_objc*URS5S-$)aFormats a datetime.datetime object (UTC) in RFC3339. https://developers.google.com/protocol-buffers/docs/reference/google.protobuf#timestamp Args: datetime_obj: A datetime.datetime object representing a datetime in UTC. Returns: The string representation of the date in RFC3339. TZ)r)rgs r1 FormatRfc3339rks    $s **r0 range_valuecV[U5nUc[R"SUS35eU$)aParse a range parameter value string into its components. Args: range_value: A range value string of the form "[, )". Returns: A tuple (, ). Raises: app.UsageError: if the input range value string was not formatted correctly. zInvalid range parameter value: z%. Expected format: "[, )")rr r.)rlrs r1ParseRangeParameterValuerns< K (& ^ .. )+7   -r0cdSU;a[U[5(a US:XaSS0$[R"U5n[ USVs/sH o"SUS4PM sn5n0nUR 5HupV[ X5U5XE'M SU0$SU;ad[U[5(a!US:XaSS0$[R"U5nUVs/sHn[ USU5PM nnU(dS 00$SU0$S U;a8US:XaS S0$[U5upS [ US U5[ US U 5S.0$S US:waU0$S0$s snf![RRaA [R"5S n[R"S U-5RU5ef=fs snf)zParse a parameter value of type `type_dict` from value_input. Arguments: type_dict: The JSON-dict type as which to parse `value_input`. value_input: Either a string representing the value, or a JSON dict for array and value types. rZr structValuesNrr<rW arrayValuesriz Error parsing string as JSON: %srr rangeValue)rr)rr#rHr|rrrOrzr{rqexc_infor r.with_tracebackrn) rJ value_inputxtype_mapr field_namertbrrs r1rOrOsi+s##  %%JJ{+kY}5MN5Mi6+5MNOH F(..0 .x/CUKf1 F ##I+s##  t$$jj- AL@K1Ik2A6   r] 6 ""9$fD !!)+6JE(3E)FN&y1C'DcJ   +"7; BBT BBCO\\ ) ) \\^A nn . < .   sE7E F- AF*)NFNNNFFFNNFNNNNNNNNNNNNN)FFFNNNNNNNNNNNNNNN)NNNNNr)T)hr __future__rrrrrrrHrJrCrrqtypingrrrr r r r abslr rrDrreclientsrrHfrontendrrrrrpyglibr version_infotyping_extensionsrrr+"PARQUET_LIST_INFERENCE_DESCRIPTIONcompileCONNECTION_ID_PATTERNrrrrrrrr2rr:r=r#rQrlrvrzrrrrrrobjectrrfrwr~rrrrrrrrrrrrr ReferenceCustomPrintFormatrrr r.r;r?rCrErArIrNr\r^rkrnrOr/r0r1rs2&%  EEE , %g66+  P#( 9-;<$?!-#       S T  #$*#s#C#E#s(O#L? Dcc#s#s#chsm 2S 2S 2 S d38n0ACADACHU38_$=N6Nl(,"&  "'&+"  #9J^! "'&*" #'vr! d38nD/#s(^// #s(^/d##s(^## #s(^#L  (,*. DN4.(,} d3S >"#037"*3- c]6%P # c]<  t!v! &**44&..& &  &R<-y- .Ls).L{22<<=.L  & $ ' .L/0.L .Lb!Hcd&.  A.8 + 1 1 +c +#%S/*.Cr0