VSrSSKrSSKJr SSKJrJr SSKJr "SS5r S Sjr g) z SQL LexerN) TextIOBase)tokenskeywords)consumecT\rSrSrSrSr\S5rSrSr Sr Sr S r S S jr S rg) LexerznThe Lexer supports configurable syntax. To add support for additional keywords, use the `add_keywords` method.NcnURcU"5nUR5 XlUR$)zJReturns the lexer instance used internally by the sqlparse core functions.)_default_intancedefault_initialization)clsdefault_instances !lib/third_party/sqlparse/lexer.pyget_default_instanceLexer.get_default_instance.s6    '"u   3 3 5#3 ###cUR5 UR[R5 UR [R 5 UR [R 5 UR [R5 UR [R5 UR [R5 UR [R5 g)zdInitialize the lexer with default dictionaries. Useful if you need to revert custom syntax settings.N) clear set_SQL_REGEXr SQL_REGEX add_keywordsKEYWORDS_COMMONKEYWORDS_ORACLEKEYWORDS_PLPGSQL KEYWORDS_HQLKEYWORDS_MSACCESSKEYWORDSselfs rr Lexer.default_initialization8s  8--. (223 (223 (334 (//0 (445 (++,rc /Ul/Ulg)zClear all syntax configurations. Useful if you want to load a reduced set of syntax configurations. After this call, regexps and keyword dictionaries need to be loaded to make the lexer functional again.N _SQL_REGEX _keywordsrs rr Lexer.clearDs rc[R[R-nUVVs/sH'up4[R"X25RU4PM) snnUlgs snnf)z.Set the list of regex that will parse the SQL.N)re IGNORECASEUNICODEcompilematchr#)rrFLAGSrxtts rrLexer.set_SQL_REGEXLsP  *$ #ZZ " ( (" -#  s.Ac:URRU5 g)z`Add keyword dictionaries. Keywords are looked up in the same order that dictionaries were added.N)r$append)rrs rrLexer.add_keywordsTs h'rcUR5nURHnX#;dM X2U4s $ [RU4$)zChecks for a keyword. If the given value is in one of the KEYWORDS_* dictionary it's considered a keyword. Otherwise, tokens.Name is returned. )upperr$rName)rvaluevalkwdicts r is_keywordLexer.is_keywordYs@ kkmnnF}{E))%;;% %rc#:# [U[5(aUR5n[U[5(aOd[U[5(a,U(aUR U5nO6UR S5nO#[SR[U555e[U5nUHupEURHupgU"X5nU(dM[U[R5(aXxR54v O4U[R La!UR#UR55v [%X8R'5U- S- 5 M [R(U4v M g![ a UR S5nNf=f7f)as Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. Split ``text`` into (tokentype, text) pairs. ``stack`` is the initial stack (default: ``['root']``) zutf-8zunicode-escapez+Expected text or file-like object, got {!r}N) isinstancerreadstrbytesdecodeUnicodeDecodeError TypeErrorformattype enumerater#r _TokenTypegrouprPROCESS_AS_KEYWORDr9rendError) rtextencodingiterableposcharrexmatchactionms r get_tokensLexer.get_tokensfsG dJ ' '99;D dC  e $ ${{8,9;;w/DI"F4:.0 0T?!IC$(OO T'(9(9:: '')++x::://!'')44%%'C-!"34%4llD(("*9;;'78D9s+A*F-E:>Cres+ %"})})@Br