2 SrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK r SSK r SSKrSSKrSSKJrJrJrJrJrJrJrJrJrJrJrJr SSKr\\S4r\ R>RAS5r!\!b\!RD(aSSK#r#OSr#\ RHRJ=(d? \ RLRASS5=(d \ RLRASS5r'Sr(\ RRS -\ RR-r*\r+S \S S4S jr,\RZ"SS 9SYSj5r.S\S S4Sjr/\ R`S:aC/\RbSZS\S\SS\\S\\S \24 Sjj5r3\RbS[S\S\SS\\S\\S \4 Sjj5r3\RbSZS\S\S\\S\\S \\2\44 Sjj5r3SZS\S\S\\S\\S \\2\44 Sjjr3\RbSZS\S\SS\\S\\S \4 Sjj5r4\RbS[S\S\SS\\S\\S \4 Sjj5r4\RbSZS\S\S\\S\\S \\\44 S jj5r4SZS\S\S\\S\\S \\\44 S!jjr40r5\Rl"5r7S\S\S\S \4S"jjr8Sq9\Rt"5r;/rS\S%\\2\4S \4S&jr?S'\S(\S \@4S)jrAS \+4S*jrBS+\+S \@4S,jrCS+\+S \@4S-jrDS+\+S \@4S.jrES \@4S/jrFSqGS+\+S \@4S0jrHS \R4S1jrJS2\S3\S \4S4jrKS5\RS6\\/\@4S7\S S4S8jrLS\S \\M4S9jrN\Rt"5rOS:\S7\S \@4S;jrP\RbS]S\S\SS\\S\\S \\\S4\S\444 S<jj5rQ\RbSZS\S\SS\\S\\S \\\S4\S\2444 S=jj5rQ\RbS]S\S\S\\S\\S \\\S4\S\2444 S>jj5rQS]S\S\S\\S\\S \\\S4\S\\2\4444 S?jjrQ"S@SA5rRSqSSB\SC\\\\\\\44SDjrTS7\S \\\\\\\44SEjrUSF\S \\\\\44SGjrVS \\4SHjrWSI\S \\4SJjrXSqYS \@4SKjrZS \\4SLjr[SMSN4SO\\\\/\@44SP\@S \4SQjjr\\]"5r^\^q_S \\4SRjr`SqaSqb\RbS^S7\S\SS \4SSjj5rc\RbS\S7\S\SS \4STjj5rc\RbS^S7\S\S \\\44SUjj5rcS^S7\S\S \\\44SVjjrcS_SWjrdS_SXjreg)`a API for accessing data files from the Google codebase. Provide a consistent API for accessing data files from the Google codebase, whether the program is being run from a PAR file, a Google3 module-space, or whatever. A "resource" is simply the contents of a named file, and can be made available by adding a data dependency in the BUILD file, e.g.: data = ["//foo/bar:filename.txt"], The name of a resource is something like `google3/tools/includes/IMPORTMAP`. Formally, it's a relative path name, and it's relative to the root of the Google code base (the directory immediately above the google, google2, google3 directories). Path components are separated by forward slashes on all platforms regardless of the native filesystem conventions. Search order for resources: 1) If this module was loaded from a parfile, look in the parfile. 2) Look relative to this module's `__file__` attribute, outside of READONLY to give files that are opened in the P4 client preference. 3) Look relative to this module's `__file__` attribute, if available 4) Look relative to `sitecustomize.GOOGLEBASE`, if available 5) Look relative to `os.environ["GOOGLEBASE"]`, if available 6) Check for a READONLY symlink for srcfs Unless otherwise noted, these functions are NOT thread-safe. N) AnyBinaryIOCallableDictIterableIteratorListLiteralOptionalTextIOTupleUnionzos.PathLike[str]_launcher_info PYTHONVERBOSERESOURCESVERBOSEigoogle3msgreturnc [(aQ[RRS[R "5<S[R S<SU<S35 gg)Nz[pid:z] r  ) _verbositysysstderrwriteosgetpidargv)rs +platform/bq/third_party/pyglib/resources.py_Logr Ss3ZJJ299; SIJ)maxsizeimportlib.abc.TraversablecT[RRS5R$)Nr) importlib resourcesfilesparentr!r _Runfilesr*Xs!    " "9 - 4 44r!pathsc0[5R"U6$)aProvide a pathlib-style access to files inside the google3 runfiles directory. This is a read-only view of data dependencies of your build rule. It is preferred over GetResource() or GetResourceFilename(). The functionality is thread-safe, and it does not trigger a .par file extraction to disk. Unlike other methods here, there is no filesystem resolution order: only one location: Either runfiles or the par file, will be observed. The return value of a Get('filename') call is an object that implements the methods of go/importlib.abc.Traversable. The important methods are: * resources.Get(path).open() -> IO[str] * resources.Get(path).open(mode='rb') -> IO[bytes] * resources.Get(path).read_bytes() -> bytes * resources.Get(path).read_text() -> str * resources.Get(path).joinpath(name) -> Traversable In a .par file context, the concrete class of the Traversable will be zipfile.Path, and in a runfiles context (such as a Python unit test) it will be pathlib.Path. Example usage: from pyglib import resources with resources.Get('google3/project/testdata/input.txt').open() as f: for line in f: process(line) testdata_dir = resources.Get('google3/project/testdata') inputs = [testdata_dir.joinpath(filename).read_text() for filename in filenames] Supported on Python 3.10 or later. Args: *paths: The path segements to join together to find the file under the runfiles directory. For example: ('google3/pyglib/build_data.txt') or ('google3/pyglib/testdata', 'gfile_test.txt') Returns: An go/importlib.abc.Traversable instance, which gives important methods like: is_dir(), is_file(), joinpath(child), open(mode=...), read_bytes() and read_text(). If the path does not exist, then no error will be raised. )r*joinpath)r+s rGetr._sb   u %%r!) rbnamemodeencodingerrorscgNr)r2r3r4r5s r GetResourcer9r!)rrtcgr7r)r8s rr9r9r:r!cgr7r)r8s rr9r9r:r!cUS;a[SU-5e[XX#5upEUc=U(deSU;a U(dSn[XAX#S9nUR5nSSS5 U$U$!,(df  U$=f)aGet the file contents of the named resource. Defaults to returning bytes, if you want str, then pass 'r' or 'rt' as the mode argument. This function is thread-safe. See also: WalkResources(), for finding what resources are available. e.g. from a directory. Args: name: The name of the resource. Example: google3/pyglib/resources.py mode: The file mode. GetResource only supports text read-only ('r' or 'rt') and binary read-only ('rb'). encoding: The name of the encoding that the data will be decoded with if necessary. Defaults to locale.getpreferredencoding. errors: Optional string specifying how decoding errors are to be handled. https://docs.python.org/3/library/codecs.html#error-handlers Returns: The contents of the named resource as a bytes object OR when text mode is specified (mode='r' or mode='rt') it is returned as a str. Raises: IOError: if the name is not found, or the resource cannot be opened. ValueError: If the mode is not supported. r;r1r<Invalid mode: %rNbstrictr4r5) ValueError FindResourceopenread)r2r3r4r5filenamedata data_files rr9r9s}> "" '$. //!$h?8 \ O8 $vf hx ?9 ^^ d @ ++ @ ? +s A%% A4cgr7r)r8s rGetResourceAsFilerMr:r!)r<r;cgr7r)r8s rrMrMr:r!cgr7r)r8s rrMrMr:r!cUS;a[SU-5e[XX#5upEU=(d UceU(aUS:wa U(dSn[XAX#S9$US:Xa[R"U5$[R "U5$)aGet the open file object to the named resource. Defaults to returning BinaryIO, if you want TextIO, then pass 'r' or 'rt' as the mode argument. This function is thread-safe. See also: WalkResources(), for finding what resources are available. e.g. from a directory. Args: name: The name of the resource. Example: google3/pyglib/resources.py mode: The file mode. GetResource only supports text read-only ('r' or 'rt') and binary read-only ('rb'). encoding: The name of the encoding that the data will be decoded with if necessary. Defaults to locale.getpreferredencoding. errors: Optional string specifying how decoding errors are to be handled. https://docs.python.org/3/library/codecs.html#error-handlers Returns: The open file object to the named resource. Raises: IOError: if the name is not found, or the resource cannot be opened. ValueError: If the mode is not supported. r@rAr1rCrD)rErFrGioBytesIOStringIO)r2r3r4r5rIrJs rrMrMs: "" '$. //!$h?8  d '' '  t|Ff  AA t| ::d  ;;t r!cA[ [RU5nU(a#[R"US5 UsSSS5 $[US5up$U(dHUce[X5n[SU<SU<S35 [U5nUb[R"X%5 SSS5 U$![ a)nUR [ R:waeSnAOSnAff=f[U N!,(df  W$=f)aPGet file name of the named resource within a par file. Don't use this function if you can use one of the above functions instead, because it's less efficient for resources in PAR files. It may return the name of a temporary file if the resource doesn't natively exist in the filesystem (i.e. part of a PAR file). This function is thread-safe. NOTE: This method might fail on diskless machines. See go/borg-python-howto#resources_apis_that_write. See also: WalkResources(), for finding what resources are available. e.g. from a directory. Args: name: The name of the resource. Example: google3/pyglib/resources.py. Must point to a file, not a directory. mode: Unused; only present for API compatibility. Returns: The absolute path to the temporary file. Raises: IOError if the name is not found, or the resource cannot be opened. Nr1z Resource z1 does not already exist, writing it to temp file r) _temporaries_lock _temporariesgetrutimeOSErrorerrnoENOENTrF_CreateTemporaryFiler _ParGetPermissionschmod)r2r3rIerJ permissionss rGetResourceFilenamera0s8 %H 4 $$D$/X    %d1h 8 't,k   '9< /+ 77ell "  # t < /s5C-B/AC-/ C"9CC-C"" C-- C<c 8[R5 [(a[[R5 $[R "5q[R5 [ R[ RR4S[S[S[[/S4S[[/[[[444SjjnS[[/S4S[[/[4S[[[/S4S [S [S [[4 S jn[R "U[ R"[ RR$U[&R([[*S 9 [$![R5 f=f)a+Get the base temp directory used by GetResourceFilenameInDirectoryTree. All files from a par file extract their files to a temporary directory, depending on how you access a resource, the temp directory it ends up in will differ. GetResourceFilename files are extracted individually GetARootDirWithAllResources are extracted to a different temp directory This function is thread-safe. NOTE: This method might fail on diskless machines. See go/borg-python-howto#resources_apis_that_write. Returns: The absolute path to the base temporary directory. pathdirnamermdirNsplitcU"U5 URUS-5(dgU"URS55upU(aURU5(dgU"U5 MB![a gf=fN/) startswithrstriprY)rcrdrerf unused_subdirs rSafeRemovedirs,GetResourceDirectory..SafeRemovedirssu  $K ??7S= ) ) !$++c"23d 11  d   sA&& A32A3unlink removedirs enoent_error directoryr'c  UHnU"U5 [SU-5 M [[UVs/sH o"U5PM sn5SS9H n U"X5 M U"XD5 [S U-5 g![an[SU<SU<S35 SnAMSnAff=fs snf![a*nXs:wa[SU <SU<S35 SnAMSnAMSnAff=f![an[SU<SU<S35 SnAgSnAff=f) z.Deleted the directory from resource directory.# deleted resource tmpfile %s # error deleting tmpfile : rNT)reversez# error deleting tmpfile path z## deleted resource tmpdirectory %s )r EnvironmentErrorsortedset) rordrprqrrr'rIr_frcs r"DeleteResourceDirectoryresourceDir@GetResourceDirectory..DeleteResourceDirectoryresourceDirsBx . 9: s61GAJ67FE4#G A& 1I =>B Ha @AAB6E  4C D D E A )Q ?@@AsLA2B B#C2 B<BB# C-CC D$C==D)rordrprqrrr')_resource_directory_lockacquire_resource_directoryreleasetempfilemkdtemprrercrfstrrr Exceptionr atexitregisterrordrZr[_resource_directory_files)rmr|s rGetResourceDirectoryrts]&""$' $$&#**,$$&$&(XX02  seTk "seU38_, - (Aud{#As #AC:t+,A A  A #Y A6 //( YYggoo<<# % O$$&sFFFcBA[RR[5U5n[RR U5(aU$[RR U5n[RR U5(d[R "U5 [US5upVUcPU(de[US5nUR5nSSS5 [R"U5RnO [!U5n["R$"[RR'U5S9up[R("U S5n U R+U5 U R-5 Ub[R."X5 [RR U5(a[R2"U 5 U$[R4"X5 [6R9U5 U$![aNnUR[R:wd$[RRU5(deSnAGNSnAff=f!,(df  GN=f![a SnGNlf=f![0[4a [R2"U 5 ef=f![ac [RR U 5(a[R2"U 5 [RR U5(deU$f=f)aGet the name of a file that contains the named resource. The file is guaranteed to have the same name as the resource and be in the same directory tree as the resource requested. All files will be created under the directory returned by GetResourceDirectory(). This function is thread-safe. NOTE: This method might fail on diskless machines. See go/borg-python-howto#resources_apis_that_write. Args: name: The name of the resource. Example: google3/pyglib/resources.py mode: Unused; only present for API compatibility. Returns: The absolute path to a file that contains the named resource. Raises: IOError: If the name is not found, or the resource cannot be opened. Nr1suffixwb)rrcjoinrexistsrdmakedirsrYrZEEXISTisdirrFrGrHstatst_moder]rmkstempbasenamefdopenrcloser^IOErrorremoverenamerappend) r2r3rIrrr_resourcefilenamerJr{r`fdtmp_pathtmp_files r"GetResourceFilenameInDirectoryTreersQ0 WW\\.0$ 7(WW^^H Oggooh')  " "kk)*$5 \    % VVXd &GG,-55k%T*K##277+;+;H+EF.2 YYr4 (  NN4 NNhhx%   ww~~hii / ii# &&x0 /a  ELL  i(@(@ )A & % k 7  IIh     ww~~hii 77>>( # #  $ /  s\HI!* I3!:J:J1+J1 IAII! I03 JJ(J.1A)LLrJc [ U[;de[RR [RR U55up#[RR [RR [ RS55SnSRX$5n[U[5(aSOSn[R"XSSUS9nURU5 URnS S S 5 W[U'S S S 5 [R&W4S jn [(R*"U 5 U$![aQn U R!S[#U5SS UR35 [R$"UR5 eS n A ff=f!,(df  N=f!,(df  N=f) a"Create a temporary file with the specified contents. The temporary file will be deleted at program finish. This function is thread-safe. Args: name: A name string to base the temporary file's name on. data: Bytes to be written to the temporary file. Returns: An absolute filename. rz{}__py_binary_resource_{}__rwF)prefixrdeleter3zFailed to write ,z bytes to temporary file NcU"U5 [SU-5 g![an[SU<SU<S35 SnAgSnAff=f)zDelete file at program exit.rtrurvrN)r rx)rorIr_s rDelete$_CreateTemporaryFile..DeleteTs@@ X ,x 78 @ (A >??@s A<A)rUrVrrcsplitextrrrformat isinstancebytesrNamedTemporaryFilerr2rxadd_notelenrrorr) r2rJ file_namerpy_binary_namerr3r{rIr_rs rr\r\0s[ | ## #(()9)9$)?@IWW%%bgg&6&6sxx{&CDQGN * 1 1) LFdE**4D  $ $U    66  "L',II@ //& /' s4ym+DQVVH M  !&&    sCCF7"F&$EF7 F#A FF##F&& F4 0F77 Gscope attributec[XS5SL$)zAChecks that a given attribute exists and is initialized properly.N)getattr)rrs r_AttributeIsInUseras 4 ( 44r!c6[5RSS5$)z;Returns the python module __loader__ active for this scope. __loader__N)globalsrWr)r!r _GetLoaderrfs |T **r!loaderc,U=(a [US5$)N_parrrs r_IsClassicBootstraprks  5%ff55r!c,U=(a [US5$)Nparrrs r_IsModernBootstrapros  4%fe44r!c[U5=(d2 [U5=(d [U5=(d S[U5;$)N FakeLoader)rr_IsHermeticParLoaderrrs r _IsParLoaderrss<&!% F #% f %% V $ r!c:[(a[R$g)z5Returns True if we are running under Hermetic Python.F)ris_google3_python_launcherr)r!rUsingPythonLauncherrs^  4 44 r!c^U(dg[(dg[U[R5$)NF) _elfzipimportrElfZipImporterrs rrrs#     FM88 99r!ct[c,[5n[U5(deUR5q[$r7)_hermetic_par_zipfilerr get_zipfilers r_GetHermeticParZipFilers5" \F  ' '' '"..0 r!parfilepathlikec[R"U5nUS- nURU5(aU[U5SnU$rh)rfspathrjr)rrrcs r_NormalizeFilenamers= 8 $ S.' __W G  D +r!zip_file predicaterccUR5HYnU"UR5(dMURX2S9nURS- nU(dMC[R "XE5 M[ g)zGExtract predicate-defined files to the path, and set permissions right.)rcN)infolistrIextract external_attrrr^)rrrcinforIr3s r_ExtractZipFilers_!d T]] # #0H    #D thhx"r!c[5n[R"U5nU(Ga[U5(aKUR U5nUR R RU5RS- [-$[U5(aDUR U5nURRU5nUbUR[-$g[U5(aF[ UR U5n[#5nURU5RS- [-$g![a gf=f![a gf=f)afGet the file permissions of the given file. Returns an integer containing the permissions or None if they can't be acquired. This function does not modify global state, so it is thread-safe. Args: name: The name of the resource. Example: google3/pyglib/resources.py Returns: An integer containing the permissions or None if they can't be acquired. rN)rrrrrr _zip_filegetinfor _OCTAL_777KeyErrorrrStoredResourcer`rarchiver)r2rresourcers rr]r]s8 <& 4$ 6"" & &t ,d KK ! ! ) )$ / = = C   F # #  & &t ,d**40h  ##j00   f % %  5d')h%33r9JFF !s$ 8D/ $D?/ D<;D<? E  E rootcJ[RRU5n[RRU5(d[RR X5n[RR U5n[RR X/5U:H$)a{Determine whether resource path is contained within root. This purposefully ignores symbolic links as resources are typically symlinked into /build/cas/... which is outside "root". Args: root: The path in which the resource is expected to be found. path: A resource path. Returns: True if "path" is a relative path or if it is an absolute path pointing within "root". )rrcabspathisabsrnormpath commonprefix)rrcs r _IsSubPathrsk  $ t   77<< #D   $ $   tl +t 33r!cgr7r)r8s rrFrFr:r!cgr7r)r8s rrFrFr:r!cgr7r)r8s rrFrFr:r!c p [RRU5n[5n[R S:XaSnO [ U5nU(a[US5(aU(a[ URU5nSSS5 [W[5(a>SU;a8URU=(d [R"S5U=(d S5n[SU-5 SU4$[#[$5upU(ak['X5(a[[RR)X5n [RR+U 5(a[S U<S U <S35 U S4$U (ak['X5(a[[RR)X5n [RR+U 5(a[S U<S U <S35 U S4$S[R,;a[R,Sn [/U SS5nU(a~['X5(an[RR)X5n [RR+U 5(a[S U<S U <S35 U S4$[S U<SU<35 [R0R3SS5nU(a~['X5(an[RR)X5n [RR+U 5(a[S U<S U <S35 U S4$[S U<SU<35 UR5S5(aUS4$Sn Sn UnU cU(dUR7S5(d[RR9U5upU b [RR)X5n OUn US:Xa [RR)US5n U cU(dUR7S5(dMU bk['X5(a[[RR)X5n [RR+U 5(a[S U<S U <S35 U S4$[RR;U5(a8U[<R?5;a[SU-5 US4$[SU-5 [![@RBSU5e!,(df  GNz=f![ a"n[S U<S U<S U<35 SnAGN?SnAff=f)axSearch for a named resource. Returns a tuple of (filename, file contents as string), where at least one element is not None, depending on the abilities of the entity where the resource was found. E.g. resources from PAR files don't have independent filenames. This function is thread-safe. Args: name: The name of the resource. Example: google3/pyglib/resources.py mode: The mode to use for opening the file. This behaves the same way as the 'mode' argument of __builtins__.open(), where 'b' must be supplied to get bytes. encoding: The name of the encoding that the data will be decoded with if necessary. Defaults to locale.getpreferredencoding. errors: Optional string specifying how decoding errors are to be handled. https://docs.python.org/3/library/codecs.html#error-handlers Returns: A tuple of (filename, file contents as string/bytes), where at least one element is not None, depending on the abilities of the entity where the resource was found. E.g. resources from PAR files don't have independent filenames. Raises: IOError: If the name is not found, or the resource cannot be opened. win32Tget_dataNrBFrCz%# loading resource %s via __loader__ z # resource z not found by loader rvz# loading resource z from z via __file__ (non-READONLY) z via __file__ (READONLY) sitecustomize GOOGLEBASEz via sitecustomize z not found via sitecustomize z via GOOGLEBASE z not found in GOOGLEBASE z ../READONLYrirREADONLYz via srcfs READONLY z# UNSUPPORTED LEGACY USAGE: loading resource from previously extracted file. resources.py is only expected to handle google3 resource paths. That is an absolute path you should open with gfile instead: %s z># discarding absolute path not pointing to known resource: %s zResource not found)"rrcrrrplatformrr_RESOURCE_LOCKrrrdecodelocalegetpreferredencodingr r_DeriveRootPathFromThisFile__file__rrisfilemodulesrenvironrWrjendswithrfrrVvaluesrZr[)r2r3r4r5ris_parrJr_r readonly_rootrIr readonly_path resource_nameheadtails rrFrF#s D   $ $ <&\\WF & !F !&*55& K t$  D% S_{{  :33E:F K vq IJJKs1,T 2S7A,T 7 TT T5T00T5c \rSrSrSrS\\SS4SjrS\S\\ \\\\\44Sjr S \S\ \ \\ 44S jrS rg) _FileIndexizA structure for holding a tree of files. This index is used internally by resources.py to help implement an os.walk style API. filenamesrNc0UlUHcnURS5RS5nU(dM,URnUSSHnXT;a0XE'XEnM USnU(dM_SXB'Me g)zCreates a file index from a list of file paths. Args: filenames: A list of strings like 'dir1/dir2/somefile'. An empty directory can be expressed as 'dir1/dir2/'. This is the same as the output of ZipFile.namelist(). riN)_dictlstriprf)selfr rI componentsd components r__init___FileIndex.__init__sx"$DJ??3'--c2j zza!#2)  !, L'Bh  r!topc #^# S[[[4S[[[[ [[ [44U4SjjmUR U5nUb$T"URS5U5HnUv M gg7f)z&Walks the directory tree like os.walk.rrc3:># /n/n[UR55nUH,upVUbURU5 MURU5 M. XU4v UH;upVUcM T"[RR X5U5HnUv M M= g7f)zYield 3-tuples for a directory.N)ryitemsrrrcr) rrdirnamesr rkventry ProcessDirs rr #_FileIndex.Walk..ProcessDirshiQWWYe$! = //!    1   y ))$! =!"'',,v"91=eK>s AB%6BNri)rrrrr r _LookupPathstrip)rrrrr s @rWalk_FileIndex.WalksvS> %T#YS 12 3$ A}ciina0% 1sBBrccURS5nUS(dUSSnURnUHnXC;a gX4nM U$)z5Returns a directory entry from self._dict for a path.rirN)rfr)rrcrrrs rr"_FileIndex._LookupPath sMCJ b>cr?j A   ,a  Hr!)r)__name__ __module__ __qualname____firstlineno____doc__r rrrr r$r rrr"__static_attributes__r)r!rr r sj S d4chuS$s)T#Y-F'GH4  c  htCH~&>  r!r  path_prefixiterablec## UHAup#nURU5(d[SU<SU<35eU[U5SX44v MC g7f)Nzpath z doesn't start with prefix )rjrEr)r.r/dirpathrr s r_TrimPathPrefixFromWalkIterabler2sV'/"g   k * * 4;[ I  #k"$ %x :: '/sA A c2[5nU(abU[R[5S:XaB[R R X5n[US-[R"U55$[ [(dF[5RSS5nU(a%[US5(a[[U55q SSS5 [(a[R![#U55$[%/5$!,(df  NB=f)auWalks the directory tree of resources similar to os.walk. This can be useful for finding files within a directory when they aren't all known ahead of time (e.g., a glob(testdata/*) situation). Args: path: A string like 'google3/pyglib'. Returns: An iterator of 3-tuples (dirpath, dirnames, filenames). For example: ('google3/pyglib', ['tests'], ['resources.py']). rrirNr)GetRunfilesDirr rpartition _GOOGLE3_STRrrcrr2walkr_par_file_indexrrWhasattrr  _ListAllFilesr$riter)rc runfiles_dirabs_pathrs r WalkResourcesr>'s !,lh&9&9,&G&JJww||L/H *sBGGH-   ?y}}\40f GFJ//$]6%:; _   D ** b/~s :AD D this_filenamec(SnSnU(Ga[RR[RR[RRU555n[RRU5nS[RR U5:XaiUn[RR U5S:Xa$Un[RRU5nX!4$[RR US5nX!4$)a@Get the root and READONLY root path of this Piper client. Args: this_filename: The complete path to this file (resources.py). Returns: A tuple of the root path and READONLY root path of this Piper client, assuming it is a client at all. Callers should test their presence on the filesystem before using them. Nrr)rrcrdrrr)r?rr google3_dirtentative_roots rrrKs- $''//  67KWW__[1NBGG$$[11 d   $ : - wwt$   T:6 r!c[RSnSU;d[5(a[5(d[n[ [ RRU55$)aGet the runfiles directory. Note: this function only looks for the runfiles dir of a google3 program run from a google3/... subtree. It will not return the similarly-named .runfiles directory created by the PAR extractor when running a PAR file. (This means that when called from a PAR file, it might return the runfiles from a containing google3 program. Please do not rely on this.) Returns: The runfiles directory for the currently-running program. rz/org.python.pydev) rrr_RunningInsideParFilerFindRunfilesDirrrcr)starting_points rr4r4lsIB88A;.^+$9$;$;N 8 99r!program_filenamecS[S[[[44SjnUR[5nUS:waUSUnX[ [5-SnU"U5upT[ R RU5Sn[ R RUSXVS-5n[ R RU5(aU$U$g) aKLook for a runfiles directory corresponding to the given program. We assume that program name is like one of: 1) /google3//. - or - /google3/bin//. Runfiles := /google3/bin//.runfiles 2) /google3/linux-dbg//.runfiles/google3/\ /.py Runfiles := /google3/linux-dbg//.runfiles Args: program_filename: absolute path to a Google3 Python program Returns: The path to the runfiles directory, or None if one wasn't found. rIrcRSH?nU[R-nURU5(dM.U[U5SnX4s $ [RR [ RS5R[R5HnUS;dM X04s $ SU4$)ayFind a match for the binary filename and its path. If the binary directory isn't known, search the program's filename for a binary directory. Args: filename: The name of the binary file. Returns: A tuple of the binary directory, and the filename relative to that directory. If the binary directory isn't known, search the program's filename for a binary directory )binz blaze-binNr) rseprjrrcrrrrf)rIbindir bindir_sepelems r_GetBinaryDirectoryFilename4FindRunfilesDir.._GetBinaryDirectoryFilenames 'BFF?j   Z ( (C O-. '  ,22266: % %~; x<r!rNrrz .runfiles) rr rfindr6rrrcrrr)rGrP google3_idxroot_dir rel_filenamerMrel_filename_noextrunfiless rrErEs$CE#s(O8!&&|4+B -H##l2C$C$EFL6|DF)),7:ww||)V+%EH ww}}X o O r!c[5nU(dg[U5=(d [U5=(d [U5$)aDetermine if we are executing within a par file or not. DO NOT USE, PLEASE. You don't need it and you don't want to have your program depend on par run context. Use the other methods in this module to make your code work anywhere, not special modes based on this hack to hack your own stuff. Note that there is a public version of this in //pyglib:parinfo if you won't be dissuaded. Returns: boolean value: True if we are running inside a par file. F)rrrrrs rrDrDs8 <&  &!& F #& f %r!cH[U5(aURR5$[U5(a-[ UR R R55$[U5(aUR5R5$[SU-5e)z7Attempt to get a python archive from the module loader.Unknown .par module loader: %r) rrNameListrryrr&keysrrnamelistNotImplementedErrorrs rr:r:s   ;;   !!&!! &**&&++- ..F##     ( ( ** >G HHr!cg)Nr))xs rrbsar!Ffilename_predicateskip_previous_extraction_checkc^^^[T[5(a TmU4SjmO[T5(d[ST<35eS[4UU4Sjjn[(a T(d[$[ 5(a[(aT(aU"5q[$[ 5nU(d [S5eU[R[5S:XaUq[$[S5e)aGet a root directory containing all the resources matching a predicate. Tries the following steps and returns at the first successful step * Returns a root dir previously found/extracted by this function and cached. This check can be skipped with skip_previous_extraction_check. * If this program is a par file, extract all files out of it into a temp tree and return its root. The temp tree is automatically cleaned on exit unless the process is terminated with an unhandled signal (i.e., SIGTERM or SIGKILL). * If this program is a google3 target built in a standard google3 client tree, find and return the runfiles directory built with it. NOTE: This function returns "a" root dir with all the resources and not "the" root dir. It is not necessary that the directory returned by this function is the one that will be used by GetResource...() functions in this module to find resources. If the executable is a par file, the first call to this function may lead to an expensive extraction of files from the par file into a new directory. NOTE: This method might fail on diskless machines. See go/borg-python-howto#resources_apis_that_write. Args: filename_predicate: Callable predicate used to filter which files are extracted from the par file, or a string that should be the prefix of all paths. skip_previous_extraction_check: Performs the extraction even if it has been done before. This is useful when using different filename_predicates in successive calls. Returns: root: Path to root directory. Raises: OSError: if an error occurs, such as disk full or unable to find the correct directory. NotImplementedError: If used with unsupported .par startup code. c&>URT5$r7)rj)rcr.s rrb-GetARootDirWithAllResources..)sdook&Br!z1filename_predicate must be callable or str, got: rc>[5n[ [U5(aa[R"SS9nUR R TSU5 [R"[RUSS9 UsSSS5 $[U5(a#URRTTS9sSSS5 $[U5(aY[R"SS9n[![#5TU5 [R"[RUSS9 UsSSS5 $[%SU-5e![a [R"USS9 ef=f![a [R"USS9 ef=f!,(df  g=f) z*Extract the par file to a local directory.z__unpar__.runfilesrfileT) ignore_errorsN)extraction_predicate force_extractrZ)rrrrrr _ExtractFilesrxshutilrmtreerrrr+ExtractMultipleResourcesByPredicateIfNeededrrrr^)rrrcrds r'_ExtractParFileResourcesUnconditionallyLGetARootDirWithAllResources.._ExtractParFileResourcesUnconditionally0sS \F  V $ $';<  ++ # # &$  t4@  f % %zzEE!38F ' .  ' '';<  024F M  t4@E J""BV"KLL7   --D 1  (   --D 1  = sL%E6D.%E6)E67$E6E1%E6 E6.!EE6!E33E66 Fz*The runfiles directory could not be found.rz@Could not create or find the directory containing all resources.) rrcallablerE_extracted_root_dirrDr4rYrr5r6)rcrdrqr<r.s`` @rGetARootDirWithAllResourcesrusT"C(($KB & ' '   ! #  (M3(M(MZ!?   "@CE  !,  > ??X((6q99& H r!c[[La[5nU(a[U5(a:URR 5 URR 5q[$[U5(a URR5q[$[U5(a[5q[$Sq[$Sq[$)aHExtracts all files if running as par file. WARNING: This function will fail with permission errors when run on Borg. You should probably call resources.GetARootDirWithAllResources() instead. This function only tries to extract files once. Subsequent calls return value cached from previous runs. NOTE: This method might fail on diskless machines. See go/borg-python-howto#resources_apis_that_write. Returns: a string, runfiles directory, or None if an error happened or if not running as par file. Raises: Will raise exceptions if zipimport implementation raises something. N) _par_extract_all_files_cache_UNINITIALIZEDrrr_ExtractAllFiles_SetAndGetRunfilesRootrrrprrurs rParExtractAllFilesr{{s&"^3 \F V $ $  $$&'-{{'I'I'K$ &% f % % JJ B B D % &%  ' '(C'D$ &%(,$ &%&*" %%r!cgr7r)rcr3argskwargss r_ParOpenrr!cgr7r)r}s rrrrr!cgr7r)r}s rrrrr!c^[RRU5nUR[5(d[ UT/UQ70UD6$[ U4SjS55(a[[RSU-5eU[[5Sn[U5nST;aU$[R"XSRSS5S9$)aeInternal method for opening a par file. Args: path: Path to the par file. mode: file mode for opening the file. *args: Other argments to apply to the Open command. **kwargs: Keyword arguments to apply to the open command. Returns: A file handle to the par file. Raises: IOError: If the parfile is not writable, should write mode be specified. c3,># UH oT;v M g7fr7r)).0write_indicatorr3s r _ParOpen..sH_D s)ra+zParfiles are not writable: %rNrBnewline)r)rrcrrj _PAR_PREFIX _BUILTIN_OPENanyrrZEROFSrrMrQ TextIOWrapperrW)rcr3r~r relative_pathfps ` rrrs  $  % % t 5d 5f 55 HHHH %++>E FFs;')*-'"D[ I  "jjD&A BBr!c[bg[5n[U5(aURRnOE[ U5(aUR RnO[U5(a URnOg[RRU5S-q[Rq[ [lg)aInstall an open that also works for files inside a par. It is highly recommended that this only be called by the main file of a py_binary and not from a py_library. Once this method is called, you can take a path to inside your par file: path = os.path.join(os.path.dirname(__file__), ...) # path = "/path/to/my.par/google3/whatever" and open it like any regular file: fp = open(path) Nri)rrrrr2rr _zip_filenamerrrrcrbuiltinsrGrr)rpar_names rInstallParOpenrs" <&zzH6""{{((HF##~~H )C/+---(-r!c^[R[:Xde[[lSqSqgr7)rrGrrrr)r!r_UninstallParOpenForTestingOnlyrs' ( "" "(--+r!)rr#)r1NN)r<NN)r1)r;NN)r;)rN)fr,rrrZ functools importlib.abcr%importlib.resourcesrQrrrnrr threadingtypingrrrrrrr r r r r rzipfiler_PathrrWrrrflagsverboserrrrLr6MetaPathFinderr lru_cacher*r. version_infooverloadrr9rMrVRLockrUrarLockr~rrrr\boolrrrrrrrrZipFilerrrintr]rrrFr r8r2r>rr4rErtrDr:ruobjectrxrwr{rrrrrr)r!rrs F   ssss c%%& !12."7"7- II- zz~~oq)- zz~~(!,  vv !BFF*  KcKdK  T"5#5 1&1&51&hg "   $-sm SM    $"   ) sm SM   "   sm SM   5#: " ) ) )sm) SM )  5#: )X"   $-sm SM    $"   ) sm SM   "   sm SM   8V  " ) ) )sm) SM )  8V  )Z OO%;e;3;#;|$>>+acaHUUU#UUp.u.E%*,=.#.b5S5S5T5 +N+ 66465~5$5DT::D:uoo*2C5$;*?GL *,U,x},b!4U4%4D4* #"   ) sm SM   5d U49- -. "   $-sm SM   5d U4;/ /0 "   sm SM   5d U4;/ /0 " h: h: h:smh: SM h:  5d U4ucz):#:; ;< h:VH H V;; (sDItCy/H)I J;!!(5d3ic1J+K"L!H 8C=(3- '(B&: &:R;c;hsm;|t0 IT#Y I =H+0uc8SE4K#889u$(u ut-)&HSM)&X  ,/ y)  '+ t}     8V !C CC 8V C@#Lr!