o gD<@sddlZddlmZmZmZmZmZmZmZm Z m Z m Z ddl m Z mZmZddlmZe edfZGddde jZGdd d ZGd d d ZGd d d ZddedefddZdS)N) IOAnyDictIteratorListNoReturnOptionalSequenceTupleUnion)grammartokentokenize) GoodTokenInfozos.PathLike[str]c@s eZdZdS) PgenGrammarN)__name__ __module__ __qualname__rrJ/var/www/html/gwz/venv/lib/python3.10/site-packages/blib2to3/pgen2/pgen.pyrsrc@seZdZUeed<eeed<eeed<e ee e ee ffed<d8dede eeddfddZ de fd d Zd e d ede e e ffd dZd e dede fddZd9ddZd eddfddZdee eedfeffddZdddddedfddZd eddddddfddZd ed edddfd!d"Zd edddfd#d$Zded%fd&d'Zded%fd(d)Zded%fd*d+Zded%fd,d-Zd8d.e d/e edefd0d1Z d9d2d3Z!d4ed5ede"fd6d7Z#dS):ParserGeneratorfilenamestream generatorfirstNreturncCspd}|durt|dd}|j}||_||_t|j|_|| \|_ |_ |dur/|i|_ | dS)Nzutf-8)encoding)opencloserrrgenerate_tokensreadlinergettokenparsedfas startsymbolr addfirstsets)selfrr close_streamrrr__init__"s  zParserGenerator.__init__c Cst}t|j}|||j|d|j|D]}dt|j }||j |<||j |<q|D]P}|j|}g}|D]0}g}t |j D]\} } |||| || fqI|jri|d||f||q>|j|||||f|j|j |<q3|j |j|_|S)Nr)rlistr#keyssortremover$insertlen symbol2number number2symbolsortedarcsitemsappend make_labelindexisfinalstates make_firststart) r&cnamesnameidfar9stater3labelnextrrr make_grammar1s.      zParserGenerator.make_grammarr<r>cCs@|j|}|dus Ji}t|D] }|||}d||<q|SN)rr2r6)r&r<r>rawfirstrrBilabelrrrr:Js     zParserGenerator.make_firstrBcCsft|j}|dr]||jvr,||jvr|j|S|j|j|df||j|<|Stt|d}t|t s;J||tj vsDJ|||j vrN|j |S|j|df||j |<|S|ddvsgJ|t |}|dr|ddkr{|j }n|j}||vr||S|jtj|f|||<|Stj|}||j vr|j |S|j|df||j |<|S)Nr)"'rI)r/labelsisalphar0 symbol2labelr5getattrr isinstanceinttok_nametokenseval soft_keywordskeywordsNAMEr opmap)r&r<rBrHitokenvaluerUrrrr6TsB                zParserGenerator.make_labelcCs8t|j}||D] }||jvr||q dSN)r*r#r+r,r calcfirst)r&r=r>rrrr%s  zParserGenerator.addfirstsetsc Cs|j|}d|j|<|d}i}i}|jD]@}||jvrK||jvr1|j|}|dur0td|n|||j|}|dusAJ|||||<qd||<|di||<qi}|D]\}} | D]} | |vrttd|| ||| f||| <qbq\||j|<dS)Nrzrecursion for rule %rrFzArule %s is ambiguous; %s is in the first sets of %s as well as %s)r#rr3 ValueErrorr[updater4) r&r>r@rAtotalset overlapcheckrBfsetinverseitsfirstsymbolrrrr[s>             zParserGenerator.calcfirstDFAStatecCsi}d}|jtjkrN|jtjkr||jtjks|tj}|tjd|\}}|tj| ||}| ||||<|durH|}|jtjks |dusTJ||fS)N:) typer ENDMARKERNEWLINEr!expectrVOP parse_rhsmake_dfa simplify_dfa)r&r#r$r>azr@rrrr"s$        zParserGenerator.parser;NFAStatefinishc st|tsJt|tsJdtdtttfffdd }dtdtttfddffdd t|||g}|D]F}i}|jD]}|jD]\}} |durU| ||iqDq?t| D] \}} |D] } | j| krln qct| |} | | | | |q]q8|S)NrArcsi}|||SrZr)rAbase addclosurerrclosures z)ParserGenerator.make_dfa..closurerrcsHt|tsJ||vr dSd||<|jD] \}}|dur!||qdSrE)rOrpr3)rArrrBrCrsrrrts z,ParserGenerator.make_dfa..addclosure) rOrprrPrdnfasetr3 setdefaultr2r4r5addarc) r&r;rqrur9rAr3nfastaterBrCrvstrrsrrls."     zParserGenerator.make_dfac Cstd||g}t|D]>\}}td|||urdpd|jD]*\}}||vr-||} n t|} |||durAtd| qtd|| fqq dS)NzDump of NFA for State(final)z -> %d %s -> %d)print enumerater3r7r/r5) r&r>r;rqtodor?rArBrCjrrrdump_nfas   zParserGenerator.dump_nfar@cCsdtd|t|D]&\}}td||jrdpdt|jD]\}}td|||fqq dS)NzDump of DFA forr{r|r}r~)rrr8r2r3r4r7)r&r>r@r?rArBrCrrrdump_dfas zParserGenerator.dump_dfacCsvd}|r9d}t|D]*\}}t|dt|D]}||}||kr3||=|D]}|||q&d}nqq |sdSdS)NTFrF)rranger/ unifystate)r&r@changesr?state_irstate_jrArrrrms zParserGenerator.simplify_dfa)rprpcCs|\}}|jdkr||fSt}t}|||||jdkr=||\}}|||||jdks$||fS)N|) parse_altrYrprxr!)r&rnroaazzrrrrks         zParserGenerator.parse_rhscCsf|\}}|jdvs|jtjtjfvr/|\}}|||}|jdvs|jtjtjfvs||fS)N)([) parse_itemrYrfr rVSTRINGrx)r&rnbr<drrrr,s   zParserGenerator.parse_altcCs|jdkr||\}}|tjd||||fS|\}}|j}|dvr0||fS||||dkrA||fS||fS)Nr])+*r)rYr!rkrir rjrx parse_atom)r&rnrorYrrrr5s     zParserGenerator.parse_itemcCs|jdkr||\}}|tjd||fS|jtjtjfvr8t }t }| ||j|||fS| d|j|jt )Nr)z+expected (...) or NAME or STRING, got %s/%s) rYr!rkrir rjrfrVrrprx raise_errorAssertionError)r&rnrorrrrIs   zParserGenerator.parse_atomrfrYcCsD|j|ks|dur|j|kr|d|||j|j|j}||S)Nzexpected %s/%s, got %s/%s)rfrYrr!)r&rfrYrrrri\szParserGenerator.expectcCsXt|j}|dtjtjfvrt|j}|dtjtjfvs|\|_|_|_|_|_ dS)Nr) rCrrCOMMENTNLrfrYbeginendline)r&tuprrrr!es  zParserGenerator.gettokenmsgargsc Gs`|rz||}Wntyd|gttt|}Ynwt||j|jd|jd|jf)N rrF) Exceptionjoinr*mapstr SyntaxErrorrrr)r&rrrrrrls  "zParserGenerator.raise_errorrZrN)$rrrPath__annotations__rrrrrrrPr(rrDr:r6r%r[r rr"rlrr rrmrkrrrrrir!rrrrrrrs.     3" '  rc@sLeZdZUeeeedfed<d ddZd dddeeddfdd Z dS) rpr3rNcCs g|_dSrZ)r3)r&rrrr(xs zNFAState.__init__rCrBcCs8|dus t|ts Jt|tsJ|j||fdSrZ)rOrrpr3r5r&rCrBrrrrx{szNFAState.addarcrrZ) rrrrr rrrr(rxrrrrrpus   rpc@seZdZUeeefed<eed<eedfed<deeefdeddfddZ d dd eddfd d Z dddZ dedefddZ dZ eed<dS)rdrvr8r3finalrNcCsLt|tsJttt|tsJt|tsJ||_||v|_i|_dSrZ)rOdictrCiterrprvr8r3)r&rvrrrrr(s   zDFAState.__init__rCrBcCs8t|tsJ||jvsJt|tsJ||j|<dSrZ)rOrr3rdrrrrrxszDFAState.addarcoldnewcCs*|jD] \}}||ur||j|<qdSrZ)r3r4)r&rrrBrCrrrrs  zDFAState.unifystateothercCsdt|tsJ|j|jkrdSt|jt|jkrdS|jD]\}}||j|ur/dSq dS)NFT)rOrdr8r/r3r4get)r&rrBrCrrr__eq__s zDFAState.__eq____hash__)rrdrrdrN)rrrrrprrboolrr(rxrrrrrrrrds  rd Grammar.txtrrcCst|}|SrZ)rrD)rprrrgenerate_grammarsr)r)ostypingrrrrrrrr r r blib2to3.pgen2r r rblib2to3.pgen2.tokenizerrrGrammarrrrprdrrrrrs0  [ )