v3 SrSSKJr SSKJr SSKJr SSKrSSKrSSKJr SSKJ r SSK J r SS K J r SS K J r SS K Jr SS K Jr SS K Jr SSKJr SSKJr SSKJr SSKJr SrSrSrSrSSjr\ R6\ R8"\ R:R<5"SS\ R>555r \ R6\ R8"\ R:RB5"SS\ 555r"g)z2Implementation of rsync command for Cloud Storage.)absolute_import)division)unicode_literalsN) arg_parsers)base)cp_command_util)encryption_util)flags)rsync_command_util) storage_url)user_request_args_factory)get_sorted_list_file_task) task_executor)task_graph_executor) task_statusa> *{command}* copies to and updates objects at `DESTINATION` to match `SOURCE`. `SOURCE` must specify a directory, bucket, or bucket subdirectory. *{command}* does not copy empty directory trees, since storage providers use a [flat namespace](https://cloud.google.com/storage/docs/folders). Note, shells (like bash, zsh) sometimes attempt to expand wildcards in ways that can be surprising. Also, attempting to copy files whose names contain wildcard characters can result in problems. If synchronizing a large amount of data between clouds you might consider setting up a Google Compute Engine account and running *{command}* there. Since *{command}* cross-provider data transfers flow through the machine where *{command}* is running, doing this can make your transfer run significantly faster than on your local workstation. a} To sync the contents of the local directory `data` to the bucket gs://my-bucket/data: $ {command} data gs://my-bucket/data To recurse into directories use `--recursive`: $ {command} data gs://my-bucket/data --recursive To make the local directory `my-data` the same as the contents of gs://mybucket/data and delete objects in the local directory that are not in gs://mybucket/data: $ {command} gs://mybucket/data my-data --recursive --delete-unmatched-destination-objects To make the contents of gs://mybucket2 the same as gs://mybucket1 and delete objects in gs://mybucket2 that are not in gs://mybucket1: $ {command} gs://mybucket1 gs://mybucket2 --recursive --delete-unmatched-destination-objects To copy all objects from `dir1` into `dir2` and delete all objects in `dir2` which are not in `dir1`: $ {command} dir1 dir2 --recursive - --delete-unmatched-destination-objects To mirror your objects across cloud providers: $ {command} gs://my-gs-bucket s3://my-s3-bucket --recursive --delete-unmatched-destination-objects To apply gzip compression to only uploaded image files in `dir`: $ {command} dir gs://my-bucket/data --gzip-in-flight=jpeg,jpg,gif,png To skip the file `dir/data1/a.txt`: $ {command} dir gs://my-bucket --exclude="data./.*\.txt$" To skip all .txt and .jpg files: $ {command} dir gs://my-bucket --exclude=".*\.txt$|.*\.jpg$" a( The contexts are preserved when using rsync to sync to Google Cloud Storage. However, the following command would clear all custom contexts from the destination object while syncing to the destination bucket. $ {command} gs://my-bucket/ gs://destination-bucket/ --clear-custom-contexts c US4US4/nUR(aURUS4US4/5 /n/nUHupg[R"URR US9nUR U5 [R"UUURURUURS9n UR U 5 M XT4$)aIGenerates tasks for creating source/destination inventories. Args: args (parser_extensions.Namespace): Command line arguments. source_container (resource_reference.Resource): Location to find source resources. destination_container (resource_reference.Resource): Location for destination resources. Returns: A tuple (list_tasks, cleanup_paths). list_tasks (List[task.Task]): The tasks to run to create inventories. cleanup_paths (List[str]): The paths where inventories are stored. The caller is responsible for removing these after transfers complete. FTis_managed_folder_list)exclude_pattern_stringsignore_symlinksmanaged_folders_onlyrecurse) include_managed_foldersextendr get_hashed_list_file_pathr url_stringappendrGetSortedContainerContentsTaskexcluder recursive) argssource_containerdestination_containerlist_task_arguments cleanup_paths list_tasks containerrpathtasks lib/surface/storage/rsync.py!_get_list_tasks_and_cleanup_pathsr+os*e$ !! D !$94#@A-*)<%i  7 7((3 D $ C C $ ,,1  Dd*=  ""c[R"U[RRS9n[R "UR RUS9n[R "UR RUS9n[RR5n[R"UUUUUURURURURUUR UR"US9 n[$R&"UUR(U(+[*R,"[*R.R0UR2S9US9$)aCreates and executes tasks for rsync commands. Args: args (parser_extensions.Namespace): Command line arguments. source_container (resource_reference.Resource): Location to find source resources. destination_container (resource_reference.Resource): Location for destination resources. perform_managed_folder_operations (bool): If True, generates manifest files and performs copy tasks for managed folders. Otherwise, does so for objects/files. Returns: Exit code (int). ) metadata_typer)compare_only_hashes$delete_unmatched_destination_objectsdry_runryield_managed_folder_operations/skip_if_destination_has_later_modification_timeskip_unsupportedtask_status_queue) manifest_path)continue_on_errorparallelizableprogress_manager_argsr5)r 'get_user_request_args_from_command_args MetadataTypeOBJECTr rr rrmultiprocessing_contextQueueget_operation_iteratorchecksums_onlyr0r1rskip_if_dest_has_newer_mtimer4r execute_tasksr7rProgressManagerArgs IncrementTypeFILES_AND_BYTESr6) r!r"r#!perform_managed_folder_operationsuser_request_argssource_list_pathdestination_list_pathr5operation_iterators r*_perform_rsyncrKs6, GG 7DDKK (AA""-->-FF''22> *AAGGI)@@--  3 3ll**&G  + +,,)#&  $ $..::';;  # # 3 3)77*  r,c8\rSrSrSr\\S.r\S5r Sr Sr g)Rsync/Synchronize content of two buckets/directories. DESCRIPTIONEXAMPLEScURSSS9 URSSS9 UR5n[R"USS9 [R"U5 [R "U5 [ R"XR5S9 [ R"U5 [ R"USS 9 [ R"U5 [ R"U5 URS S S S 9 URSS [R"S5S 9 URSS SS 9 URSSS[R "5SS9 URSSS SS 9 g)NsourcezThe source container path.)help destinationzThe destination container path.T)hidden) release_track)defaultz--checksums-only store_truezWhen comparing objects with matching names at the source and destination, skip modification time check and compare object hashes. Normally, hashes are only compared if modification times are not available.)actionrUz&--delete-unmatched-destination-objectsa7 Delete extra files under DESTINATION not found under SOURCE. By default extra files are not deleted. Managed folders are not affected by this flag. Note: this option can delete data quickly if you specify the wrong source and destination combination.z --dry-runzJPrint what operations rsync would perform without actually executing them.z-xz --excludeREGEXa&Exclude objects matching regex pattern from rsync. Note that this is a Python regular expression, not a pure wildcard pattern. For example, matching a string ending in "abc" is `.*abc$` rather than `*abc`. Also note that the exclude path is relative, as opposed to absolute (similar to Linux `rsync` and `tar` exclude options). For the Windows cmd.exe command line interpreter, use `^` as an escape character instead of `\` and escape the `|` character. When using Windows PowerShell, use `'` instead of `"` and surround the `|` character with `"`.)metavartyperUz-uz--skip-if-dest-has-newer-mtimezYSkip operating on destination object if it has a newer modification time than the source.) add_argument add_groupr add_preserve_acl_flagadd_predefined_acl_flagadd_encryption_flagsradd_cp_mv_rsync_flags ReleaseTrackadd_gzip_in_flight_flagsadd_ignore_symlinks_flagadd_recursion_flag add_include_managed_folders_flagtextwrapdedentrArgList)clsparseracl_flags_groups r*Args Rsync.Argssv 'CD  ,MN&&(O = !!/2 v&))..0,,V4,,VTB&&v.44V<  5   0 __34        " 0 $  ( 2 r,c[R"U5 [R"UUR/[ R "UR55 [R"[RRUR5UR5n[R"[RRUR5UR5n[XU5upE[ R""UUR$SS9nU(a'X`lUHn[R("U5 M gUR*(a:[-UUUSS9nU(a'X`lUHn[R("U5 M g[-UUUSS9UlUHn[R("U5 M g!UHn[R("U5 M f=f)NT)r7r8)rFF)r initialize_key_storer validate_include_managed_foldersrTr storage_url_from_stringrVr get_existing_container_resourceosr( expanduserr0get_existing_or_placeholder_destination_resourcer+rrBr7 exit_codetry_to_delete_filerrK)selfr!r"r#r&r%rzr(s r*Run Rsync.Run:s((.44  ++D,<,<= *II 4;;')=)= KK GG  t// 0$2F2F  !B 5!J!4--  22i "0 $--d3 -  % %"   !.2  %.  $--d3 &   ,1 dn $--d3 -$--d3 s7-G*GG!G")rzN) __name__ __module__ __qualname____firstlineno____doc___COMMAND_DESCRIPTION _GA_EXAMPLES detailed_help classmethodrpr}__static_attributes__r,r*rMrMs28*- IIV64r,rMc(\rSrSrSr\\\-S.rSr g) RsyncAlphaisrOrPrN) rrrrrrr_ALPHA_EXAMPLESrrrr,r*rrss8*0-r,r)F)#r __future__rrrrwrjgooglecloudsdk.callioperr"googlecloudsdk.command_lib.storagerr r r r r (googlecloudsdk.command_lib.storage.tasksrrrrrrrr+rKUniverseCompatible ReleaseTracksreGACommandrMALPHArrr,r*rs9&' /(>>4A:HNBH@"- \.#j', AHD%%(()J4DLLJ4*J4ZD%%++,-r,