o lQ@sdZddlmZddlmZddlmZddlZddlZddlmZ ddl m Z ddl mZdd l mZddlm Z ddlZdd lmZd d ZGd ddeZ  dddZGdddeZdS)aA class for projecting and transforming JSON-serializable objects. From the Cloud SDK doc "DD: gcloud resource projection algorithm": Algorithm The algorithm represents a resource R and projection P as trees. P is used to color the nodes of R (with the colors {0, 1, 2, 3}) as follows: 1. Initialize the nodes in R to (id, 0, identity). 2. Do a DFS on P. Let p be the projection subtree and r be the resource subtree at each level. Let f be a flag value at each level, and initialize f to the flag value of the root node of P. 2.1. For each id i in p that is also in r, set r[i].flag |= p[i].flag | f, and r[i].transform = p[i].transform if r[i].transform != identity and p[i].transform != identity. 2.2. If p contains a slice then repeat step 2.1 with i = slice. 2.3. If r[i].flag is 0 then prune the search at this node, otherwise 2.4. descend to the next level with r = r[i], p = p[i], and f = r[i].flag. 3. At the end of the search the nodes of R will be colored with the values {0, 1, 2, 3}. The projected keys are the set of the longest paths from the root of R ending with a flag value >= 2. Remarks If the initial value of f is PROJECT or PROJECT* (2 or 3) then all keys in R are projected. Non-leaf keys may be projected in this model, resulting in dict or list values instead of scalars. Example usage: projector = resource_projector.Compile(expression) for resource in resources: obj = projector.Evaluate(resource) OperateOnProjectedResource(obj) )absolute_import)division)unicode_literalsN)messages)encoding)resource_projection_parser)resource_property)rangecCs t|S)zReturns resource or a JSON-serializable copy of resource. Args: resource: The resource object. Returns: The original resource if it is a primitive type object, otherwise a JSON-serializable copy of resource. )CompileEvaluate)resourcer L/tmp/google-cloud-sdk/lib/googlecloudsdk/core/resource/resource_projector.pyMakeSerializableGs rc@sxeZdZdZ  dddZddZddZd d Zd d Zd dZ dddZ ddZ ddZ ddZ ddZddZdS) Projectora Projects a resource using a ProjectionSpec. A projector is a method that takes an object and a projection as input and produces a new JSON-serializable object containing only the values corresponding to the keys in the projection. Optional projection key attributes may transform the values in the resulting JSON-serializable object. Attributes: _projection: The projection object. _been_here_done_that: A set of the current object id()'s being projected. Used to catch recursive objects like datetime.datetime.max. _by_columns: True if Projector projects to a list of columns. _columns: self._projection.Columns() column attributes. _ignore_default_transforms: Ignore default projection transforms if True. _retain_none_values: Retain dict entries with None values. _transforms_enabled_attribute: The projection.Attributes() transforms_enabled setting. _transforms_enabled: Projection attribute transforms enabled if True, disabled if False, or set by each Evaluate(). FcCsh||_||_|j|_||_||_t|_|}d|vr"d|_ n d|vr*d|_ nd|_ d|v|_ dS)a0Constructor. Args: projection: A ProjectionSpec (parsed resource projection expression). by_columns: Project to a list of columns if True. ignore_default_transforms: Ignore default projection transforms if True. retain_none_values: project dict entries with None values. transformsTz no-transformsFNz json-decode) _projection _by_columnsColumns_columns_ignore_default_transforms_retain_none_valuesset_been_here_done_that Attributes_transforms_enabled_attribute _json_decode)self projection by_columnsignore_default_transformsretain_none_values attributesr r r__init__js  zProjector.__init__cCs"|jdur|jS|jd|jjfvS)zReturns True if transform is enabled. Args: transform: The resource_projection_parser._Transform object. Returns: True if the transform is enabled, False if not. N)_transforms_enabledactiver)r transformr r r_TransformIsEnableds zProjector._TransformIsEnabledcCsP||jjkrdS|r|jr|jjr||jjr|jj|S|j|||ddS)a"Applies projection.attribute.transform in projection if any to obj. Args: obj: An object. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. Returns: The transformed obj if there was a transform, otherwise the original obj. NTleaf)rPROJECT attributer&r'r _Project)robjrflagr r r_ProjectAttributes  zProjector._ProjectAttributec Csi}t}t|tjrt||d<|dnz|ddt|jDWn ty0Ynwt|D]O}| dr=q5||vrBq5zt ||}WnYq5t |drUq5|}||j vrx|j |} || j jO}||jjkrnq5||| |||<q5|||j|||<q5|S)a-Converts class object to a dict. Private and callable attributes are omitted in the dict. Args: obj: The class object to convert. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. Returns: The dict representing the class object. datetime)maxmin resolutiontzinfocSsg|]}|r|qSr )isupper).0ar r r sz+Projector._ProjectClass..___call__)r isinstancer0six text_typeupdatedir __class__AttributeError startswithgetattrhasattrtreer+r.rINNERr,r/GetEmpty) rr-rr.rexcludeattrvaluefchild_projectionr r r _ProjectClasss<           zProjector._ProjectClassc Cs|s|Si}zt|Wn tyYdSwt|D]V\}}|}||jvrB|j|}||jjO}||jjkr:q||||}n | ||j |}|dus\|j s\||jj krs|j rsz ||t|<Wqtyr|||<Yqwq|pwdS)zProjects a dictionary object. Args: obj: A dict. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. Returns: The projected obj. N)r< iteritems ValueErrorrEr+r.rrFr,r/rGrr*rrDecode UnicodeError) rr-rr.reskeyvalrLrMr r r _ProjectDicts4        zProjector._ProjectDictc sRdurdSs gSzt}zd}Wn ty"tYnwWnty?ztWn ty<YYdSwYnwtg}d}|jsR||jjkrQdSn4|jD]0}|durn||jjksh|j|jj rm|j|}qUt |t j r|t t tvr||qU||jjkr|s|j}|s|sdSd}|rdgt} ndgtfdd|Dd} |rt tn|D]U}|} | durq|} ||jvr|j|} |r| |jj O} n|} | r| | jj O} | |jjkr|| | | } nd} | durq|dkr |t7}||kr|}| | |<q|dkrdS|r'| d|dS| S)zProjects a list, tuple or set object. Args: obj: A list, tuple or set. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. Returns: The projected obj. Nrc3s(|]}|dkr|tn|VqdS)rN)len)r6xr-r r Fs&z)Projector._ProjectList..)rX TypeErrorsortedlistrrErr*r+r.r;r< integer_typesr addrGr1rFr,) rr-rr.r9indicesslicedindexmaxindexrSrUrLrMr rZr _ProjectLists                          zProjector._ProjectListc Cs|t|}||jvr dS|durn!t|tjst|tjrWt|tjr(t|}|jrV| dr5| ds?| drV| drVz |j t ||||dWStyUYnwnt|tttfset|tjrfnt|trstt|}nt|tjr}|j}n|j|ddlm}ddl}t|tjrt|}n0t||jrdd lm}||}nt||jr|j !|}nt"|d rt"|d r|#|||}|r|j$r|j$j%r|&|j$j%r|j$j%'|}nI||j(j)ks|r*|j*r*t"|d r*t"|d rz |+|||}Wn&t,t-fyd}Ynwz |.|||}Wnt,t-fy)d}Ynw|j/||S|r7|S|0|||S) aEvaluate() helper function. This function takes a resource obj and a preprocessed projection. obj is a dense subtree of the resource schema (some keys values may be missing) and projection is a sparse, possibly improper, subtree of the resource schema. Improper in that it may contain paths that do not exist in the resource schema or object. _Project() traverses both trees simultaneously, guided by the projection tree. When a projection tree path reaches an non-existent obj tree path the projection tree traversal is pruned. When a projection tree path terminates with an existing obj tree path, that obj tree value is projected and the obj tree traversal is pruned. Since resources can be sparse a projection can reference values not present in a particular resource. Because of this the code is lenient on out of bound conditions that would normally be errors. Args: obj: An object. projection: Projection _Tree node. flag: A bitmask of DEFAULT, INNER, PROJECT. leaf: Do not call _ProjectAttribute() if True. Returns: An object containing only the key:values selected by projection, or obj if the projection is None or empty. Nz{"}[]r(r)message) json_format__iter___fieldsitems)1idrr;r<r= binary_typerrQrrBendswithr,jsonloadsrPboolfloatcomplexr` bytearraybytesprotorpc_messageEnumnameracloudsdk.google.protobufrjprotoMessageprotorpc_encoding MessageToDictrkr@to_dictrDrNr+r&r'r rr*rErVIOErrorr]rfdiscardr/) rr-rr.r)objidprotobuf_messager}protobuf_encodingr r rr,us                   zProjector._ProjectcC ||_dS)z{Sets the projection to list-of-columns mode. Args: enable: Enables projection to a list-of-columns if True. N)rrenabler r r SetByColumns zProjector.SetByColumnscCr)zuSets the ignore default transforms mode. Args: enable: Disable default projection transforms if True. N)rrr r rSetIgnoreDefaultTransformsrz$Projector.SetIgnoreDefaultTransformscCr)zSets the projection to retain-none-values mode. Args: enable: Enables projection to a retain-none-values if True. N)rrr r rSetRetainNoneValuesrzProjector.SetRetainNoneValuescCs|j|_|jr |js,|jrd|_|jj}n|jj}t|dr"| }| ||j |S| ||j |jj}|jdurB|j |_g}|jD]&}|jrSt||jn|}|jjrh||jjrh|jj||}||qG|S)aSerializes/projects/transforms obj. A default or empty projection expression simply converts a resource object to a JSON-serializable copy of the object. Args: obj: An object. Returns: A JSON-serializeable object containing only the key values selected by the projection. The return value is a deep copy of the object: changes to the input object do not affect the JSON-serializable copy. FrN)rr$rrrrDEFAULTr*rDrr,TreerGrrTrGetr+r&r'r append)rr-r.obj_serializedcolumnscolumnrUr r rr s4        zProjector.EvaluatecCs|jS)zzReturns the ProjectionSpec object for the projector. Returns: The ProjectionSpec object for the projector. )rrr r r ProjectionszProjector.ProjectionN)FFF)F)__name__ __module__ __qualname____doc__r#r'r/rNrVrfr,rrrr rr r r rrTs   9( oa ,rFcCs tj|||td}t|||dS)aCompiles a resource projection expression. Args: expression: The resource projection string. defaults: resource_projection_spec.ProjectionSpec defaults. symbols: Transform function symbol table dict indexed by function name. by_columns: Project to a list of columns if True. retain_none_values: Retain dict entries with None values. Returns: A Projector containing the compiled expression ready for Evaluate(). )defaultssymbolscompiler)rr!)rParser r) expressionrrrr!rr r rr #s r cs(eZdZdZfddZddZZS)IdentityProjectorz>A no-op resource projector that preserves the original object.cstt|tdSN)superrr#rrrr@r rr#:szIdentityProjector.__init__cCs|Srr )rr-r r rr =szIdentityProjector.Evaluate)rrrrr#r __classcell__r r rrr7s r)rNNFF)r __future__rrrr0rrapitools.base.protorpcliterryapitools.base.pyrrgooglecloudsdk.core.resourcerrgooglecloudsdk.core.utilr< six.movesr robjectrr rr r r rs, %         R