@ S r SSKJr SSKJr SSKJr SSKJr SSKrSSKJr SSKJ r SS KJ
r
SS
KJ r SS K J
r
SS K Jr SS
KJr SSKJr SSKJr SSKJr SSKJr SSKJr SSKJr SSKJr SSK J r SSK J r SSK J r SSK!J"r" SSK#J$r$ SSK%J&r& SSK%J'r' SS K(J)r) SS K*J+r+ \ RX r-S r.S \.- S - r/S! r0S" r1S'S# jr2S$ r3 " S% S&\
5 r4g)(zCImplementation of Unix-like rm command for cloud storage providers. )absolute_import)print_function)division)unicode_literalsN)BucketNotFoundException)NotEmptyException)NotFoundException)ServiceException)Command)DecrementFailureCount)CommandArgument) ApiSelector)CommandException)NO_URLS_MATCHED_PREFIX)NO_URLS_MATCHED_TARGET)NameExpansionIterator) SeekAheadNameExpansionIterator)StorageUrlFromString)MetadataMessage) constants)parallelism_framework_util)GetCloudApiInstance)Retry)GcloudStorageFlag)GcloudStorageMap)
StdinIterator)PreconditionsFromHeadersz7
gsutil rm [-f] [-r] url...
gsutil rm [-f] [-r] -I
z
SYNOPSIS
aU
DESCRIPTION
NOTE: As part of verifying the existence of objects prior to deletion,
``gsutil rm`` makes ``GET`` requests to Cloud Storage for object metadata.
These requests incur `network and operations charges
`_.
The gsutil rm command removes objects and/or buckets.
For example, the following command removes the object ``kitten.png``:
gsutil rm gs://bucket/kitten.png
Use the -r option to specify recursive object deletion. For example, the
following command removes gs://bucket/subdir and all objects and
subdirectories under it:
gsutil rm -r gs://bucket/subdir
When working with versioning-enabled buckets, note that the -r option removes
all object versions in the subdirectory. To remove only the live version of
each object in the subdirectory, use the `** wildcard
`_.
The following command removes all versions of all objects in a bucket, and
then deletes the bucket:
gsutil rm -r gs://bucket
To remove all objects and their versions from a bucket without deleting the
bucket, use the ``-a`` option:
gsutil rm -a gs://bucket/**
If you have a large number of objects to remove, use the ``gsutil -m`` option,
which enables multi-threading/multi-processing:
gsutil -m rm -r gs://my_bucket/subdir
You can pass a list of URLs (one per line) to remove on stdin instead of as
command line arguments by using the -I option. This allows you to use gsutil
in a pipeline to remove objects identified by a program, such as:
some_program | gsutil -m rm -I
The contents of stdin can name cloud URLs and wildcards of cloud URLs.
Note that ``gsutil rm`` refuses to remove files from the local file system.
For example, this fails:
gsutil rm *.txt
WARNING: Object removal cannot be undone. Cloud Storage is designed to give
developers a high amount of flexibility and control over their data, and
Google maintains strict controls over the processing and purging of deleted
data. If you have concerns that your application software or your users may
at some point erroneously delete or replace data, see
`Options for controlling data lifecycles
`_ for ways to
protect your data from accidental data deletion.
OPTIONS
-f Continues silently (without printing error messages) despite
errors when removing multiple objects. If some of the objects
could not be removed, gsutil's exit status will be non-zero even
if this flag is set. Execution will still halt if an inaccessible
bucket is encountered. This option is implicitly set when running
"gsutil -m rm ...".
-I Causes gsutil to read the list of objects to remove from stdin.
This allows you to run a program that generates the list of
objects to remove.
-R, -r The -R and -r options are synonymous. Causes bucket or bucket
subdirectory contents (all objects and subdirectories that it
contains) to be removed recursively. If used with a bucket-only
URL (like gs://bucket), after deleting objects and subdirectories
gsutil deletes the bucket. This option implies the -a option and
deletes all object versions. If you only want to delete live
object versions, use the `** wildcard
`_
instead of -r.
-a Delete all versions of an object.
c U R ( d$ U R R [ U5 5 [ U[
5 ( a: U =R S-
sl U R R [ U5 5 g[ U R U5 ( a [ 5 gU =R S-
sl
g)z9Simple exception handler to allow post-completion status. N) continue_on_errorloggererrorstr
isinstancer bucket_not_found_count _ExceptionMatchesBucketToDeletebucket_strings_to_deleter op_failure_countclses $platform/gsutil/gslib/commands/rm.py_RemoveExceptionHandlerr- s JJSV *++ !# JJSV &s'C'CQGG a c [ U[ 5 ( a [ UR ; d [ U[ 5 ( a [ 5 gUe)z3When removing folders, we don't mind if none exist.N)r$ r r reasonr r r) s r, _RemoveFoldersExceptionHandlerr1 s5 !%&&+AQXX+M A( ) )
Gr. c " U R XS9 g )N thread_state)
RemoveFunc)r* name_expansion_resultr4 s r, _RemoveFuncWrapperr7 s ..&.Br. c U ( aP [ S- nU[ U5 ; a7 [ U5 R U5 n[ U5 S:H =( a US U ; $ gg)a Returns True if the exception matches a bucket slated for deletion.
A recursive delete call on an empty bucket will raise an exception when
listing its objects, but if we plan to delete the bucket that shouldn't
result in a user-visible error.
Args:
bucket_strings_to_delete: Buckets slated for recursive deletion.
e: Exception to check.
Returns:
True if the exception was a no-URLs-matched exception and it matched
one of bucket_strings_to_delete, None otherwise.
r N)r r# splitlen)r' r+ msgpartss r, r& r& sU
2
%C
c!f}!fll3 e
Z1_
Eq-E!EE r. c ^ \ rS rSrSr\R " S/ SQ\S\R SSSS\
R \
R /\
R \
R " 5 /S9 r\R " S/ SQS S
\0 S 9r\" S S/\" S
5 \" S
5 \" S5 \" S5 \" S5 S.S9rS rSS jrSrg) RmCommand z$Implementation of gsutil rm command.rm)deldeleteremover afIrRF) command_name_aliasesusage_synopsismin_argsmax_argssupported_sub_args file_url_okprovider_url_okurls_start_arggs_api_supportgs_default_apiargparse_arguments command_helpzRemove objects) help_namehelp_name_aliases help_typehelp_one_line_summary help_textsubcommand_help_textstorage-r-a-Iz--continue-on-error)rZ -Rr[ r\ -f)gcloud_commandflag_mapc Z
^ ^ T R T l ST l ST l T R ( a^ T R HN u pUS:X a ST l M US:X a ST l M# US:X a ST l M2 US:X d US:X d M@ ST l ST l MP T R ( a' T R ( a [ S5 e[ 5 nO(T R ( d [ S 5 eT R nS
T l S
T l
/ n/ T l T R
( a S /nU H n[ U5 mTR 5 ( d TR 5 ( d M: T R U5 R! US 9 H9 nUR# UR$ 5 T R R# U5 M; M [' T R( =( d 0 5 T l [- T R. T R0 T R2 T R4 UT R
T R6 T R T R =( d T R S
9 nSn T R ( dO [9 T R. T R0 T R; 5 UT R
T R T R6 S9n T R= [> U[@ T R ( + SS/U S9 T R ( a [ S5 eT R ( a T R ( d [ S5 eT R
( a / n U HH n[ U5 mTRI 5 ( d M% U R# URK S5 S- 5 MJ U ( ax ST l [- T R. T R0 T R2 T R4 U T R
T R6 T R S9nT R= [> U[L SS9 U H? mT R2 RU ST5 [W [X SSS 9U U4S j5 n U " 5 MA T R ( a/ T R ( a S OS n
[ S T R X4- 5 eg
! [ a1 n
[C T R U
5 ( a [E 5 Sn
A
GNe Sn
A
f[F a n
T R ( d e Sn
A
GN
Sn
A
ff = f! [ a0 n
U
RN RQ [R 5 ( d e Sn
A
GN Sn
A
ff = f)!z'Command entry point for the rm command.Fr[ Tr^ r\ rZ r] z&No arguments allowed with the -I flag.z5The rm command (without -I) expects at least one URL.r id)
bucket_fields)
project_id all_versionsr N)re rd r( r% )
fail_on_error shared_attrsseek_ahead_iteratorz.Encountered non-existent bucket during listingz Some files could not be removed.*z
*_$folder$)rd re )rf Removing %s... r )tries timeout_secsc b > T R R TR TR S9 g )N)provider)
gsutil_api DeleteBucket bucket_namescheme)selfurls r, BucketDeleteWithRetry3RmCommand.RunCommand..BucketDeleteWithRetry~ s" $$S__szz$Jr. sr9 z(%d file%s/object%s could not be removed.)-parallel_operationsr read_args_from_stdinre sub_optsrecursion_requestedargsr r r( r% r' r IsBucket
IsProviderWildcardIterator IterBucketsappend storage_urlr headers
preconditionsr command_namedebugr! rp rd r GetSeekAheadGsutilApiApplyr7 r- r& r r
IsObjectrstripr1 r0
startswithr infor r )rt ounused_aurl_strsbucket_urls_to_deleterc url_strblrname_expansion_iteratorrh r+ folder_object_wildcardsrv
plural_strru s ` @r,
RunCommandRmCommand.RunCommand sz " 5 5D %D D }} +! 9 "$
$Y#'$
$Y&*$
#
$Y!t)%)$
" "$
'
GHH h
YY 0 1 1h D #$D $&D! fm '"7+ <<>>S^^ - -**73?? ) @ +c ! ( ( 9 ) ) 0 0 9+ 2$,,2D"ED3 5
**
++
//
"
"__(( 2 2 Nd6N6N !P !
&
& < JJ & & ( $ $ ** ( jj#(($($:$: : 13K L%8 :0 "" M NN T%;%; ? @@
" '"7+ <<>>
!
(
( )<|)K
L
!!% $9 jjkkoo%&& ,,%.
! **',3#( * %
kk'-
aa8K 9K % //3Rj G " 3 3Z L M
N N
A
))F)F J J
#
#
$H $$%;<< = sD DR
A0S0
S-%SS
S-S((S-0
T*:%T%%T*Nc [ XS9nUR nU R R SU5 UR UR
UR U R UR UR S9 [ UR [ [ R " 5 S95 g ! [ a0 nU R R SU5 [ 5 S nANfS nAff = f)Nr3 rj )r
generationro zCannot find %s) message_time)r expanded_storage_urlr! r DeleteObjectrr object_namer r rs r r _PutToQueueWithTimeout status_queuer time)rt r6 r4 rp exp_src_urlr+ s r, r5 RmCommand.RemoveFunc s $TEJ'<,>)4)?)?'2'9'9 ; :22* DF kk'5 s AB) )
C#3&C C#)re r% r' r r( r rz r| N)__name__
__module__ __qualname____firstlineno____doc__r CreateCommandSpec _SYNOPSISr NO_MAXr XMLJSONr
MakeZeroOrMoreCloudURLsArgument command_specHelpSpec_DETAILED_HELP_TEXT help_specr r gcloud_storage_mapr r5 __static_attributes__ r. r, r@ r@ s , **
6 !oo{'7'78 %%)IIKL N, 3 ,#
) ( &!$'!$'!$'!$'!"78 \
|Fr. r@ r )5r
__future__r r r r r gslib.cloud_apir r r r
gslib.commandr r gslib.command_argumentr
gslib.cs_api_mapr gslib.exceptionr r r gslib.name_expansionr r gslib.storage_urlr gslib.thread_messager gslib.utilsr r gslib.utils.cloud_api_helperr gslib.utils.retry_utilr gslib.utils.shim_utilr r gslib.utils.system_utilr gslib.utils.translation_helperr PutToQueueWithTimeoutr r r r- r1 r7 r& r@ r r. r, r s J & % ' 3 - - , ! / 2 ( , 2 2 6 ? 2 0 ! 2 < ( 3 2 1 C3II
VX v $ CF,YF YFr.