*\SrSSKJr SSKJr SSKJr SSKJr SSKJr SSK J r SSK J r SS K Jr SS KJr SS KJr SS KJr SS KJr \R,\R."\R0R2\R0R45"SS\R6555rg)z:`gcloud dataplex datascans create data-discovery` command.)absolute_import)division)unicode_literals)datascan)util) exceptions) arg_parsers)base) resource_args) labels_util)log) propertiesc\rSrSrSrSS\R RRR5S30r \ S5r \ R"S5S5rS rg ) DataDiscovery zCreate a Dataplex data discovery scan job. Allows users to auto discover BigQuery External and BigLake tables from underlying Cloud Storage buckets. EXAMPLESa/ To create a data discovery scan `data-discovery-datascan` in project `test-project` located in `us-central1` on Cloud Storage bucket `test-bucket`, run: $ {command} data-discovery-datascan --project=test-project --location=us-central1 --data-source-resource="//storage.z7/projects/test-project/buckets/test-bucket" cv[R"US5 URSSSS9 URSSSS9 URSS S S9 URS S 9nURS S 9nURSSSS.SS9 URSSS 9 URSSS 9 URSSS 9 URSS 9nURS[R "5SSS9 URS[R "5SS S9 URS!S 9nURS"S#S 9 URS$S%S 9 URS&S'S 9 URS([ S)S*9 URS+S,S 9 URS-S 9nURS.S/S 9 URS0[ S1S*9 URS2S 9nURS S3S49nURS5[ S6S*9 URS7S8S 9 URS SS9S:9nURS;S9 [RRU5 [R"U5 g)?Nz$to create a data discovery scan for.z --descriptionFz'Description of the data discovery scan.)requiredhelpz--display-namez(Display name of the data discovery scan.z--data-source-resourceTzFully-qualified service resource name of the cloud resource bucket that contains the data for the data discovery scan, of the form: `//storage.googleapis.com/projects/{project_id_or_number}/buckets/{bucket_id}`.z&Data spec for the data discovery scan.)rzABigQuery publishing config arguments for the data discovery scan.z --bigquery-publishing-table-typezNDefault value. Cloud Storage bucket is discovered to BigQuery External tables.z>Cloud Storage bucket is discovered to BigQuery BigLake tables.)EXTERNALBIGLAKEzBigQuery table type to discover the cloud resource bucket. Can be either `EXTERNAL` or `BIGLAKE`. If not specified, the table type will be set to `EXTERNAL`.)choicesrz --bigquery-publishing-connectionzBigQuery connection to use for auto discovering cloud resource bucket to BigLake tables in format `projects/{project_id}/locations/{location_id}/connections/{connection_id}`. Connection is required for `BIGLAKE` BigQuery publishing table type.z%--bigquery-publishing-dataset-projectzThe project of the BigQuery dataset to publish BigLake external or non-BigLake external tables to. If not specified, the cloud resource bucket project will be used to create the dataset. The format is "projects/{project_id_or_number}.z&--bigquery-publishing-dataset-locationa)The location of the BigQuery dataset to publish BigLake external or non-BigLake external tables to. If not specified, the dataset location will be set to the location of the data source resource. Refer to https://cloud.google.com/bigquery/docs/locations#supportedLocations for supported locations.z5Storage config arguments for the data discovery scan.z--storage-include-patternsPATTERNzList of patterns that identify the data to include during discovery when only a subset of the data should be considered. These patterns are interpreted as glob patterns used to match object names in the Cloud Storage bucket.)typemetavarrz--storage-exclude-patternszList of patterns that identify the data to exclude during discovery. These patterns are interpreted as glob patterns used to match object names in the Cloud Storage bucket. Exclude patterns will be applied before include patterns.z2CSV options arguments for the data discovery scan.z--csv-header-row-countzuThe number of rows to interpret as header rows that should be skipped when reading data rows. The default value is 1.z--csv-delimiterznDelimiter used to separate values in the CSV file. If not specified, the delimiter will be set to comma (",").z--csv-encodingzXCharacter encoding of the CSV file. If not specified, the encoding will be set to UTF-8.z--csv-disable-type-inferencezlWhether to disable the inference of data types for CSV data. If true, all columns are registered as strings.)rrz--csv-quote-characterzThe character used to quote column values. Accepts " (double quotation mark) or ' (single quotation mark). If unspecified, defaults to " (double quotation mark).z3JSON options arguments for the data discovery scan.z--json-encodingzYCharacter encoding of the JSON file. If not specified, the encoding will be set to UTF-8.z--json-disable-type-inferencezmWhether to disable the inference of data types for JSON data. If true, all columns are registered as strings.z'Data discovery scan execution settings.z4Data discovery scan scheduling and trigger settings.)mutexrz --on-demandzJIf set, the scan runs one-time shortly after data discovery scan creation.z --scheduleaCron schedule (https://en.wikipedia.org/wiki/Cron) for running scans periodically. To explicitly set a timezone to the cron tab, apply a prefix in the cron tab: "CRON_TZ=${IANA_TIME_ZONE}" or "TZ=${IANA_TIME_ZONE}". The ${IANA_TIME_ZONE} may only be a valid string from IANA time zone database. For example, `CRON_TZ=America/New_York 1 * * * *` or `TZ=America/New_York 1 * * * *`. This field is required for RECURRING scans.z:At most one of --async | --validate-only can be specified.)rrrz--validate-only store_truez:Validate the create action, but don't actually perform it.)actiondefaultr) r AddDatascanResourceArg add_argument add_groupr ArgListboolr ASYNC_FLAG AddToParserr AddCreateLabelsFlags) parser data_specbigquery_publishing_config_argstorage_config_argcsv_options_argjson_options_argexecution_spectrigger async_groups 7lib/surface/dataplex/datascans/create/data_discovery.pyArgsDataDiscovery.Args4s((6  6   7    _   5!I&/%8%8 O&9&" #//*eU   *0 #//* 0 #/// ?0#//0 (0 #,, D-##$  " 9 $ ##$  " A $ )22 A3O    G!   D!   %!  &  ? !   C!*33 B4!! ."!!'  ? "%% 6&N&&O'G      C "" I#K  I   OO ,$$V,z-Status code: {status_code}. {status_message}.c :URRR5n[USS5 [R "5nUR R[R"5RUR5UR5R5[R"U5S95n[USS5(a [R R#S5 g[USS5nU(d[[R$"U5n[R&"UR(SR+UR,UR.5S 9 U$[R R#S R+X$R(55 U$) N scan_type DISCOVERY) dataScanIdparentgoogleCloudDataplexV1DataScan validate_onlyFz1Validation completed. Skipping resource creation.async_z@Data discovery scan created in project [{0}] with location [{1}])detailszACreating data discovery scan with path [{0}] and operation [{1}].)CONCEPTSrParsesetattr dataplex_utilGetClientInstanceprojects_locations_dataScansCreateGetMessageModule/DataplexProjectsLocationsDataScansCreateRequestNameParent RelativeName GenerateDatascanForCreateRequestgetattrr statusPrintWaitForOperationCreatedResourcenameformat projectsId locationsId)selfargs datascan_refdataplex_client create_req_opr<responses r1RunDataDiscovery.RunsG==))//1L D+{+#557O#@@GG&&(XX#((*&&(557*2*S*S+ Y Mt_e,, jjJK T8U +F **=9h  --Pvl--|/G/GH oJJK  00 1 r4N)__name__ __module__ __qualname____firstlineno____doc__rVALUEScoreuniverse_domainGet detailed_help staticmethodr2gcloud_exception CatchHTTPErrorRaiseHTTPExceptionrZ__static_attributes__r\r4r1rr sC DNDUDUDZDZDjDjDnDnDpCqq  -F-F-P445""r4rN)ra __future__rrrgooglecloudsdk.api_lib.dataplexrrrAgooglecloudsdk.api_lib.utilrrhgooglecloudsdk.callioper r #googlecloudsdk.command_lib.dataplexr $googlecloudsdk.command_lib.util.argsr googlecloudsdk.corer rDefaultUniverseOnly ReleaseTracks ReleaseTrackALPHAGACommandrr\r4r1rxsA&'4AF/(=<#*D%%++T->->-A-AB@DLL@C@r4