o |@sdZddlmZddlmZddlmZddlZddlZddlmZddlm Z ddlm Z dd lm Z ddl Z dd l mZdd l mZd Zed ZGdddeZGdddeZdddZGdddeZddZdddZdS)aResource expression lexer. This class is used to parse resource keys, quoted tokens, and operator strings and characters from resource filter and projection expression strings. Tokens are defined by isspace() and caller specified per-token terminator characters. " or ' quotes are supported, with these literal escapes: \\ => \, \' => ', \" => ", and \ => \. Typical resource usage: # Initialize a lexer with the expression string. lex = resource_lex.Lexer(expression_string) # isspace() separated tokens. lex.SkipSpace() returns False at end of input. while lex.SkipSpace(): # Save the expression string position for syntax error annotation. here = lex.GetPosition() # The next token must be a key. key = lex.Key() if not key: if lex.EndOfInput(): # End of input is OK here. break # There were some characters in the input that did not form a valid key. raise resource_exceptions.ExpressionSyntaxError( 'key expected [{0}].'.format(lex.Annotate(here))) # Check if the key is a function call. if lex.IsCharacter('('): # Collect the actual args and convert numeric args to float or int. args = lex.Args(convert=True) else: args = None # Skip an isspace() characters. End of input will fail with an # 'Operator expected [...]' resource_exceptions.ExpressionSyntaxError. lex.SkipSpace(token='Operator') # The next token must be one of these operators ... operator = lex.IsCharacter('+-*/&|') if not operator: # ... one of the operator names. if lex.IsString('AND'): operator = '&' elif lex.IsString('OR'): operator = '|' else: raise resource_exceptions.ExpressionSyntaxError( 'Operator expected [{0}].'.format(lex.Annotate())) # The next token must be an operand. Convert to float or int if possible. # lex.Token() by default eats leading isspace(). operand = lex.Token(convert=True) if not operand: raise resource_exceptions.ExpressionSyntaxErrorSyntaxError( 'Operand expected [{0}].'.format(lex.Annotate())) # Process the key, args, operator and operand. Process(key, args, operator, operand) )absolute_import)division)unicode_literalsN)resource_exceptions)resource_projection_spec)resource_property)resource_transform)map)rangez:=!<>~()z[].{},+*/%&|^#;?c@s.eZdZdZ  d ddZddZdd ZdS) _TransformCallaA key transform function call with actual args. Attributes: name: The transform function name. func: The transform function. active: The parent projection active level. A transform is active if transform.active is None or equal to the caller active level. map_transform: If r is a list then apply the transform to each list item up to map_transform times. map_transform>1 handles nested lists. args: List of function call actual arg strings. kwargs: List of function call actual keyword arg strings. rNcCs0||_||_||_||_|pg|_|pi|_dSN)namefuncactive map_transformargskwargs)selfr rrrrrrF/tmp/google-cloud-sdk/lib/googlecloudsdk/core/resource/resource_lex.py__init__ns  z_TransformCall.__init__cCsRdd|jD}|jdkrd|j}n |jdkrd}nd}d||jd|S) NcSs g|] }t|tjr dn|qS)z ) isinstancerProjectionSpec).0argrrr xsz*_TransformCall.__str__..z map({0}).zmap().z {0}{1}({2}),)rrformatr join)rrprefixrrr__str__ws  z_TransformCall.__str__cCs t|Sr )copy)rmemorrr __deepcopy__ z_TransformCall.__deepcopy__)rrNN)__name__ __module__ __qualname____doc__rr"r%rrrrr `s   r c@s~eZdZdZddZddZeddZedd Zed d Z ed d Z eddZ ddZ ddZ ddZdddZdS) _TransformzAn object that contains an ordered list of _TransformCall objects. Attributes: _conditional: The resource_filter expression string for the if() transform. _transforms: The list of _TransformCall objects. cCsd|_g|_dSr ) _conditional _transformsrrrrrs z_Transform.__init__cCsddtt|jS)Nz[{0}].)rr r strr-r.rrrr"sz_Transform.__str__cC|jr |jdjSdS)z4The transform active level or None if always active.rNr-rr.rrrrz_Transform.activecC|jS)z1The if() transform conditional expression string.r,r.rrr conditionalsz_Transform.conditionalcCs4t|jdks|jdjtjkrdS|jdjdS)aThe global restriction string or None if not a global restriction. Terms in a fiter expression are sometimes called "restrictions" because they restrict or constrain values. A regular restriction is of the form "attributeoperand". A "global restriction" is a term that has no attribute or . It is a bare string that is matched against every attribute value in the resource object being filtered. The global restriction matches if any of those values contains the string using case insensitive string match. Returns: The global restriction string or None if not a global restriction. rrN)lenr-r rGLOBAL_RESTRICTION_NAMErr.rrrglobal_restrictions  z_Transform.global_restrictioncCr1)zThe name of the last transform.r)r-r r.rrrr r3z_Transform.namecCs|jr |jdjdSdS)z"The first global restriction term.rr)r-rr.rrrtermsz_Transform.termcCs|jo |jd|fvS)z=Returns True if the Transform active level is None or active.Nr2)rrrrrIsActivesz_Transform.IsActivecCs|j|dS)zAdds a transform to the list.N)r-append)r transformrrrAddsz_Transform.AddcC ||_dS)z'Sets the conditional expression string.Nr5)rexprrrrSetConditionalr&z_Transform.SetConditionalNc Cs|jD]h}|jdkr|dur|}|jrXt|rX|}t|jdD]}g}z |D]}||q(Wn ty;Ynw|}q!g}|D]}||j |g|j Ri|j qCq|s]|jsk|j |g|j Ri|j }q|S)zEApply the list of transforms to obj and return the transformed value.uriNr) r-r rr IsListLiker extend TypeErrorr=rrr)robjoriginal_objectr>items_nesteditemrrrEvaluates.   $ z_Transform.Evaluater )r'r(r)r*rr"propertyrr6r9r r;r<r?rBrMrrrrr+s$     r+cCs t}|t||||d|S)aReturns a transform call object for func(*args, **kwargs). Args: func_name: The function name. func: The function object. args: The actual call args. kwargs: The actual call kwargs. Returns: A transform call object for func(obj, *args, **kwargs). )rr)r+r?r ) func_namerrrcallsrrr MakeTransforms rQc@seZdZdZdZdZd*ddZd*ddZd d Zd d Z d*d dZ d+ddZ d,ddZ d-ddZ  d.ddZd/ddZddZdd Zd!d"Zd#d$Zd0d&d'Zd1d(d)ZdS)2Lexera[Resource expression lexer. This lexer handles simple and compound tokens. Compound tokens returned by Key() and Args() below are not strictly lexical items (i.e., they are parsed against simple grammars), but treating them as tokens here simplifies the resource expression parsers that use this class and avoids code replication. Attributes: _ESCAPE: The quote escape character. _QUOTES: The quote characters. _defaults: ProjectionSpec object for aliases and symbols defaults. _expr: The expression string. _position: The index of the next character in _expr to parse. \z'"NcCs"|pd|_d|_|p t|_dS)zInitializes a resource lexer. Args: expression: The expression string. defaults: ProjectionSpec object for aliases and symbols defaults. rrN)_expr _positionrr _defaults)r expressiondefaultsrrrrs zLexer.__init__cCs|dur|j}|t|jkS)zChecks if the current expression string position is at the end of input. Args: position: Checks position instead of the current expression position. Returns: True if the expression string position is at the end of input. N)rUr7rTrpositionrrr EndOfInputs zLexer.EndOfInputcCr4)zbReturns the current expression position. Returns: The current expression position. rUr.rrr GetPosition&szLexer.GetPositioncCr@)zSets the current expression position. Args: position: Sets the current position to position. Position should be 0 or a previous value returned by GetPosition(). Nr\rYrrr SetPosition.s zLexer.SetPositioncCs~|dur|n|j}d}|dkr|j|dsd|}|t|jkr.|j|s.|d7}d|jd|||j|dS)a*Returns the expression string annotated for syntax error messages. The current position is marked by '*HERE*' for visual effect. Args: position: Uses position instead of the current expression position. Returns: The expression string with current position annotated. Nz*HERE*rr z {0}{1}{2})rUrTisspacer7r)rrZherecursorrrrAnnotate7s "zLexer.AnnotatercCs\|s|j|j}|r||vrdS|jd7_|r|r,td||dS)aSkips spaces in the expression string. Args: token: The expected next token description string, None if end of input is OK. This string is used in the exception message. It is not used to validate the type of the next token. terminators: Space characters in this string will not be skipped. Raises: ExpressionSyntaxError: End of input reached after skipping and a token is expected. Returns: True if the expression is not at end of input. Trz{0} expected [{1}].F)r[rTrUr`rExpressionSyntaxErrorrrc)rtoken terminatorscrrr SkipSpaceJs zLexer.SkipSpaceFcCsV|r|s|r dStd||j|j}||vr dS|s)|jd7_|S)aChecks if the next character is in characters and consumes it if it is. Args: characters: A set of characters to check for. It may be a string, tuple, list or set. peek: Does not consume a matching character if True. eoi_ok: True if end of input is OK. Returns None if at end of input. Raises: ExpressionSyntaxError: End of input reached and peek and eoi_ok are False. Returns: The matching character or None if no match. NzMore tokens expected [{0}].r)r[rrdrrcrTrU)r characterspeekeoi_okrgrrr IsCharacterds  zLexer.IsCharactercCst|sdS|}|j|d|sdS|t|7}||s/|j|s/|j|dkr8|s6||dSdS)a4Skips leading space and checks if the next token is name. One of space, '(', or end of input terminates the next token. Args: name: The token name to check. peek: Does not consume the string on match if True. Returns: True if the next space or ( separated token is name. FN(T)rhr]rT startswithr7r[r`r^)rr rjirrrIsStrings  & zLexer.IsStringTc Cs4d}d}d}d}|} || s|j| } | |jkrO|| dsO|j| d} |dur/g}| |jkrE| |krE|s?| |jvrE||j|| | d7} nr| |krVd}nk|sh| |jvrh| }d}|durgg}nY|ss| rs|dursnN|s|r| dvr| dkr|d7}n | |vr|sn?|d8}|durg}|| n&|s|s| |vrn&|s| r|dur|r|durg}|| n|durn | d7} || r|rtd || | | |r|j |d |durd |}|r|r|szt|WStyzt|WYStyYY|Sww|S) aParses a possibly quoted token from the current expression position. The quote characters are in _QUOTES. The _ESCAPE character can prefix an _ESCAPE or _QUOTE character to treat it as a normal character. If _ESCAPE is at end of input, or is followed by any other character, then it is treated as a normal character. Quotes may be adjacent ("foo"" & ""bar" => "foo & bar") and they may appear mid token (foo" & "bar => "foo & bar"). Args: terminators: A set of characters that terminate the token. isspace() characters always terminate the token. It may be a string, tuple, list or set. Terminator characters are not consumed. balance_parens: True if (...) must be balanced. space: True if space characters should be skipped after the token. Space characters are always skipped before the token. convert: Converts unquoted numeric string tokens to numbers if True. Raises: ExpressionSyntaxError: The expression has a syntax error. Returns: None if there is no token, the token string if convert is False or the token is quoted, otherwise the converted float / int / string value of the token. NFrrTz()rmzUnterminated [{0}] quote [{1}].)rfr)r]r[rT_ESCAPE_QUOTESr=r`rrdrrcr^rhr int ValueErrorfloat) rrfbalance_parensspaceconvertquotequotedre paren_countrorgrrrTokens           .    z Lexer.Tokenrc Csd}g}|d} |}|j|d|d}|d}|r|} n|j|dd} | s7|}td|||durG|sA| sF||n|sK|sVtd|||r[ |S|  }q ) aParses a separators-separated, )-terminated arg list. The initial '(' has already been consumed by the caller. The arg list may be empty. Otherwise the first ',' must be preceded by a non-empty argument, and every ',' must be followed by a non-empty argument. Args: convert: Converts unquoted numeric string args to numbers if True. separators: A string of argument separator characters. Raises: ExpressionSyntaxError: The expression has a syntax error. Returns: [...]: The arg list. F)T)rvrxrkz*Closing ) expected in argument list [{0}].NzArgument expected [{0}].) r]r|rlrrdrrcr`r=) rrx separatorsrequiredrrfrarendseprrrArgss<    z Lexer.ArgscCsfd}|dr|d7}|ds|sdSd|jd|j|||j|jd|_|j|8_dS)z-Checks for N '*' chars shorthand for .map(N).r*rNz {}map({}).{})rlrrTrU)r map_levelrrr_CheckMapShorthand+s  zLexer._CheckMapShorthandcCsg}d}|s||}|jtdd}|r?|jdddd}|s9|s9||jjvr9|jj|\}}||n8| |n2|jdddsq|sf|d rf|jd dddsf|sa|jtdddrf ||fSt d | ||rz ||fS|d rt d | ||jddd r|jd dd}|d | ||jddd s|jd dd s ||fS|rt d | |r||fS)aParses a resource key from the expression. A resource key is a '.' separated list of names with optional [] slice or [NUMBER] array indices. Names containing _RESERVED_OPERATOR_CHARS must be quoted. For example, "k.e.y".value has two name components, 'k.e.y' and 'value'. A parsed key is encoded as an ordered list of tokens, where each token may be: KEY VALUE PARSED VALUE DESCRIPTION --------- ------------ ----------- name string A dotted name list element. [NUMBER] NUMBER An array index. [] None An array slice. For example, the key 'abc.def[123].ghi[].jkl' parses to this encoded list: ['abc', 'def', 123, 'ghi', None, 'jkl'] Raises: ExpressionKeyError: The expression has a key syntax error. Returns: (key, attribute) The parsed key and attribute. attribute is the alias attribute if there was an alias expansion, None otherwise. NF)rwrmT)rjrk[)rjr/z"Non-empty key name expected [{0}].]zUnmatched ] in key [{0}].r~)rx)r[rr]r|_RESERVED_OPERATOR_CHARSrlrValiasesrEr=rrdrrc)rkey attributerar is_functionkindexrrrKeyWithAttribute;sd      %zLexer.KeyWithAttributecCs|\}}|S)zEParses a resource key from the expression and returns the parsed key.)r)rrrJrrrKeys z Lexer.Keyc sg|D]T}t|}|dstdg}|D]8}d|vr+|dd\}}d}nd|vr@|dd\}} t| }d}n t|}d}d}||||fq|qfdd} | S) aParses the synthesize() transform args and returns a new transform. The args are a list of tuples. Each tuple is a schema that defines the synthesis of one resource list item. Each schema item is an attribute that defines the synthesis of one synthesized_resource attribute from an original_resource attribute. There are three kinds of attributes: name:literal The value for the name attribute in the synthesized resource is the literal value. name=key The value for the name attribute in the synthesized_resource is the value of key in the original_resource. key: All the attributes of the value of key in the original_resource are added to the attributes in the synthesized_resource. Args: args: The original synthesize transform args. Returns: A synthesize transform function that uses the schema from the parsed args. Example: This returns a list of two resource items: synthesize((name:up, upInfo), (name:down, downInfo)) If upInfo and downInfo serialize to {"foo": 1, "bar": "yes"} and {"foo": 0, "bar": "no"} then the synthesized resource list is [{"name": "up", "foo": 1, "bar": "yes"}, {"name": "down", "foo": 0, "bar": "no"}] which could be displayed by a nested table using synthesize(...):format="table(name, foo, bar)" rmz-(...) args expected in synthesize() transform:rN=c slg}D]/}i}|D]#}|\}}}|rt||dn|}|r#|||<q t|tr-||q ||q|S)zSynthesize a new resource list from the original resource r. Args: r: The original resource. Returns: The synthesized resource list. N)rGetrdictupdater=) rsynthesized_resource_listschemasynthesized_resourceattrr rliteralvalueschemasrr _Synthesizes      z+Lexer._ParseSynthesize.._Synthesize)rRrlrrdrsplitrr=) rrrlexrrr rrrrrrr_ParseSynthesizes.(      zLexer._ParseSynthesizerc Cs|}|jj|}|std|||g}i}t|dd}|r0t j |vr0| |jt|ddrR| D]} | d\} } } | rK| || <q:| | q:n|| 7}t||||||dS)aParses a transform function call. The initial '(' has already been consumed by the caller. Args: func_name: The transform function name. active: The transform active level or None if always active. map_transform: Apply the transform to each resource list item this many times. Returns: A _TransformCall object. The caller appends these to a list that is used to apply the transform functions. Raises: ExpressionSyntaxError: The expression has a syntax error. %Unknown transform function {0} [{1}].r*N __defaults__r)rrrr)r]rVsymbolsgetrUnknownTransformErrorrrcgetattrrPROJECTION_ARG_DOCr=r partitionr ) rrOrrrarrrdocrr rvalrrr_ParseTransforms0        zLexer._ParseTransformcCs^|}t}d} |j|||d}|jtjkrd}d}nV|jtjkr2|jr-t|jdnd}d}nA|jtj krSt |jdkrJt d ||||jdn |jtjkrl||j|_g|_i|_||nd}|||jddds} |S|}|}|d st d ||t |dkrt d d||||}q ) amParses one or more transform calls and returns a _Transform call object. The initial '(' has already been consumed by the caller. Args: func_name: The name of the first transform function. active: The transform active level, None for always active. Returns: The _Transform object containing the ordered list of transform calls. rT)rrNrz-Conditional filter expression expected [{0}].r/r~rmz"Transform function expected [{0}].r)r]r+rrrTransformAlways TransformMaprrs TransformIfr7rrdrrcrBTransformSynthesizerrr?rlrrr pop)rrOrrarPrr>callrrr Transforms^          zLexer.Transformr )Nr)FF)F)rFTF)Fr)rN)r)r'r(r)r*rqrrrr[r]r^rcrhrlrpr|rrrrrrrrrrrrRs,       d0D V,rRcCs0t|}|}|std||S)aReturns a parsed key for the dotted resource name string. This is an encapsulation of Lexer.Key(). That docstring has the input/output details for this function. Args: name: A resource name string that may contain dotted components and multi-value indices. Raises: ExpressionSyntaxError: If there are unexpected tokens after the key name. Returns: A parsed key for he dotted resource name string. zUnexpected tokens [{0}] in key.)rRrr[rrdrrc)r rrrrrParseKey>s rTFcCsg}|D]Q}|dur|r qd}|r|d|7<qn5t|tjr6|r$qdj|d}|r5|d|7<qn|rPtd|rP|dd}|d d }d j|d}||q|r]d |Sd S) aReturns the string representation for a parsed key. This is the inverse of Lexer.Key(). That docstring has the input/output details for this function. Args: key: A parsed key, which is an ordered list of key names/indices. Each element in the list may be one of: str - A resource property name. This could be a class attribute name or a dict index. int - A list index. Selects one member is the list. Negative indices count from the end of the list, starting with -1 for the last element in the list. An out of bounds index is not an error; it produces the value None. None - A list slice. Selects all members of a list or dict like object. A slice of an empty dict or list is an empty dict or list. quote: "..." the key name if it contains non-alphanum characters. omit_indices: Omit [...] indices if True. Returns: The string representation of the parsed key. Nz[]r:z[{part}])partz[^-@\w]rSz\\"z\"z"{part}"r/) rsix integer_typesrresearchreplacer=r )rry omit_indicespartsrrrr GetKeyNameVs0      r)NN)TF)r* __future__rrrr#rgooglecloudsdk.core.resourcerrrrr six.movesr r OPERATOR_CHARSrobjectr r+rQrRrrrrrrs2 7        ( cF