F,SrSSKJr SSKJrJr SSKJr SSKJ r SSK J r SSK J r SS KJr SS KrSS KrS r"S S \"\\55r"SS\5r"SS\"\\55r"SS\5r"SS\5r"SS\5rg )zC Lexer interface and implementation. Used for syntax highlighting. )unicode_literals)ABCMetaabstractmethod)with_metaclass)range)Token) to_cli_filter) split_linesN)Lexer SimpleLexer PygmentsLexer SyntaxSync SyncFromStart RegexSyncc(\rSrSrSr\S5rSrg)r z Base class for all lexers. cg)z Takes a :class:`~prompt_toolkit.document.Document` and returns a callable that takes a line number and returns the tokens for that line. N)selfclidocuments /lib/third_party/prompt_toolkit/layout/lexers.py lex_documentLexer.lex_documentrN)__name__ __module__ __qualname____firstlineno____doc__rr__static_attributes__rrrr r s  rr c,\rSrSrSr\S4SjrSrSrg)r 'z{ Lexer that doesn't do any tokenizing and returns the whole input as one token. :param token: The `Token` for this lexer. Nc$XlUbX lggNtoken)rr) default_tokens r__init__SimpleLexer.__init__.s  $&J %rc0^^URmUU4SjnU$)NcN>TRTU4/$![a /s$f=f)z&Return the tokens for the given line. )r) IndexError)linenolinesrs rget_line*SimpleLexer.lex_document..get_line7s2 U6]344   s  $$)r1)rrrr2r1s` @rrSimpleLexer.lex_document4s  rr() rrr r!r"rr+rr#rrrr r 's #$' rr c(\rSrSrSr\S5rSrg)r@a Syntax synchroniser. This is a tool that finds a start position for the lexer. This is especially important when editing big documents; we don't want to start the highlighting by running the lexer from the beginning of the file. That is very slow when editing. cg)z Return the position from where we can start lexing as a (row, column) tuple. :param document: `Document` instance that contains all the lines. :param lineno: The line that we want to highlight. (We need to return this line, or an earlier position.) Nrrrr0s rget_sync_start_position"SyntaxSync.get_sync_start_positionGrrrN)rrr r!r"rr9r#rrrrr@s   rrc\rSrSrSrSrSrg)rRz: Always start the syntax highlighting from the beginning. cg)Nrrrr8s rr9%SyncFromStart.get_sync_start_positionVsrrN)rrr r!r"r9r#rrrrrRs rrc<\rSrSrSrSrSrSrSr\ S5r Sr g ) rZzI Synchronize by starting at a line that matches the given regex pattern. idc|[U[R5(de[R"U5Ulgr') isinstancesix text_typerecompile_compiled_pattern)rpatterns rr+RegexSync.__init__fs*'3==1111!#G!4rcURnURn[U[SX R- 5S5H0nUR XE5nU(dMXVR 54s $ X R:agUS4$)z7Scan backwards, and find a possible position to start. r>r)rIr1rmax MAX_BACKWARDSmatchstartFROM_START_IF_NO_SYNC_POS_FOUND)rrr0rJr1irPs rr9!RegexSync.get_sync_start_positionjs{((vs2v0B0B'BCRHAMM%(+Eu++-''I 88 819 rcXSSSSS.nURURS5nU"U5$)zF Create a :class:`.RegexSync` instance for this Pygments lexer class. z^\s*(class|def)\s+z <[/a-zA-Z]z \bfunction\b)PythonzPython 3HTML JavaScript^)getname)cls lexer_clspatternsps rfrom_pygments_lexer_cls!RegexSync.from_pygments_lexer_cls~s:.-"*   LL -1v r)rIN) rrr r!r"rOrRr+r9 classmethodr`r#rrrrrZs4 M'*#5(rrcD\rSrSrSrSrSrS Sjr\S Sj5r Sr S r g) raX Lexer that calls a pygments lexer. Example:: from pygments.lexers import HtmlLexer lexer = PygmentsLexer(HtmlLexer) Note: Don't forget to also load a Pygments compatible style. E.g.:: from prompt_toolkit.styles.from_pygments import style_from_pygments from pygments.styles import get_style_by_name style = style_from_pygments(get_style_by_name('monokai')) :param pygments_lexer_cls: A `Lexer` from Pygments. :param sync_from_start: Start lexing at the start of the document. This will always give the best results, but it will be slow for bigger documents. (When the last part of the document is display, then the whole document will be lexed by Pygments on every key stroke.) It is recommended to disable this for inputs that are expected to be more than 1,000 lines. :param syntax_sync: `SyntaxSync` object. 2rBNcUb[U[5(deXl[U5UlU"SSSS9UlU=(d [ RU5Ulg)NF)stripnlstripallensurenl) rDrpygments_lexer_clsr sync_from_startpygments_lexerrr` syntax_sync)rrjrkrms rr+PygmentsLexer.__init__s`"jj&I&III"4,_=1 '_)*K*KL^*_rczSSKJn SSKJn U"U5nU"URUS9$!Ua [ 5s$f=f)z# Create a `Lexer` from a filename. r) ClassNotFound)get_lexer_for_filename)rk) pygments.utilrppygments.lexersrq __class__r )r\filenamerkrprqrls r from_filenamePygmentsLexer.from_filenamesH 0: R3H=N~//Q Q !=  !s '::ct^^^^^^^^^ 0m0m UU4SjmU U4SjmSUU4SjjmUUUUU U4SjmUUU 4SjnU$)z Create a lexer function that takes a line number and returns the list of (Token, text) tuples as the Pygments lexer returns for that line. c\>TRT5(a [5$TR$)z9The Syntax synchronisation objcet that we currently use. )rkrrm)rrsrget_syntax_sync3PygmentsLexer.lex_document..get_syntax_syncs(##C(($&'''rcr>TR5H"upX :dM X- TR:dM Us $ g)zAReturn a generator close to line 'i', or None if none was fonud. N)itemsREUSE_GENERATOR_MAX_DISTANCE)rS generatorr0line_generatorsrs rfind_closest_generator:PygmentsLexer.lex_document..find_closest_generators3%4%:%:%<! :!*t/P/P"P$$&=rcN>^^UUUU4Sjn[[U"55T5$)zw Create a generator that yields the lexed lines. Each iteration it yields a (line_number, [(token, text), ...]) tuple. c3># SRTRTS5TSnTRRU5H upnX#4v M g7f)N )joinr1rlget_tokens_unprocessed)text_tvcolumnrr start_linenos r get_tokensMPygmentsLexer.lex_document..create_line_generator..get_tokenssOyy !>?H $22II$OGA!$J PsA A) enumerater )rrrrrs`` rcreate_line_generator9PygmentsLexer.lex_document..create_line_generators#   [6 E Erc>T"U5nU(aU$[SUT R- 5nUS:XaSnSnOT"5RTU5up#T"U5nU(aU$T"X#5nU(a[U5 US- nUTU'U$)zG Find an already started generator that is close, or create a new one. rr )rNMIN_LINES_BACKWARDSr9next) rSrrowrrrrrzrrs r get_generator1PygmentsLexer.lex_document..get_generators /q1I  Aq43334AAv-/GGRST /q1I  1#> Yq),OI & rc>TU$![a> T"U5nUH,up#UTU'X :XdMUTU'US-T;aTUS- TUs s$ /$f=f)z+Return the tokens for a given line number. r )KeyError)rSrnumlinecacherrs rr2,PygmentsLexer.lex_document..get_line(sz *Qx *)!, "+IC!%E#Jx56 27e+ %cAg$Sz)"+I% *s!AA AA)rr) rrrr2rrrrrzrs ``` @@@@@@rrPygmentsLexer.lex_documents?  ( %  F F"% % N 0r)rlrjrkrm)TN)T) rrr r!r"rr~r+rbrvrr#rrrrrs98 $'  ` R Rhrr)r" __future__rabcrrrEr six.movesrprompt_toolkit.tokenrprompt_toolkit.filtersr utilsr rG__all__objectr r rrrrrrrrs('&0    N7F +  %2 0 $J8 8vkEkr