o g}@sdZddlmZddlZddlZddlZddlZddlZddlZddl Z ddl m Z m Z m Z mZmZddlmZddlmZmZe e jZdd d ZGd d d ejZdddZGdddZejZdddZdS)z"Better tokenizing for coverage.py.) annotationsN)IterableListOptionalSetTuple)env)TLineNoTSourceTokenLinestoks TokenInfosreturnc csd}d}d}|D]p\}}\}}\}} } ||kr_|r]|dr]d} |dr)d} n|tjkr@d|vr@|dd d ddkr@d} | r]t|dd d } td d|| f|| d f|V| }|tjtjfvri|}t||||f|| f| V|}q dS)aBReturn all physical tokens, even line continuations. tokenize.generate_tokens() doesn't return a token for the backslash that continues lines. This wrapper provides those tokens so that we can re-create a faithful representation of the original source. Returns the same values as generate_tokens() Nz\ T\F ri) endswithtokenSTRINGsplitlentokenize TokenInfoNEWLINENL) r last_line last_lineno last_ttextttypettextslinenoscolelinenoecolltextinject_backslashccolr*S/var/www/html/bloggers_ems/venv/lib/python3.10/site-packages/coverage/phystokens.py _phys_tokenss4    r,c@sFeZdZdZdddZejdkrdd d Zejd kr!dddZdSdS)SoftKeywordFinderzCHelper for finding lines with soft keywords, like match/case lines.sourcestrr NonecCst|_|t|dSN)setsoft_key_linesvisitastparse)selfr.r*r*r+__init__RszSoftKeywordFinder.__init__ node ast.MatchcCs8|j|j|jD] }|j|jjq ||dSz Invoked by ast.NodeVisitor.visitN)r3addlinenocasespattern generic_visit)r7r<caser*r*r+ visit_MatchXs zSoftKeywordFinder.visit_Match)r: ast.TypeAliascCs|j|j||dSr>)r3r?r@rC)r7r<r*r*r+visit_TypeAlias`sz!SoftKeywordFinder.visit_TypeAliasN)r.r/r r0)r<r=r r0)r<rGr r0) __name__ __module__ __qualname____doc__r8sys version_inforErHr*r*r*r+r-Ps    r-r.r/r ccstjtjtjtjh}g}d}|ddd}t|}t j j r%t |j }t|D]\}}\}} \} } } d} td|D]} | dkrL|Vg}d}d}nv| dkrSd}no||vrZd}nh| rm| |krm|d d | |fd} tj|d d d }|tjkrt|rd}n2tjdkrt j j rt|rt|dkrd}nt|dkr|ddd krd}nd}|r||vrd}||| fd}d} q<|r| }q)|r|Vd Sd S)aGenerate a series of lines, one for each line in `source`. Each line is a list of pairs, each pair is a token:: [('key', 'def'), ('ws', ' '), ('nam', 'hello'), ('op', '('), ... ] Each pair has a token class, and the token text. If you concatenate all the token texts, and then join them with newlines, you should have your original `source` back, with two differences: trailing white space is not preserved, and a final line with no newline is indistinguishable from a final line with a newline. rz rTz( )Frws xxNr:keyr9r)rINDENTDEDENTrrr expandtabsreplacegenerate_tokensr PYBEHAVIOR soft_keywordsr-r3r,rerappendtok_namegetlowerNAMEkeyword iskeywordrMrN issoftkeywordr)r. ws_tokenslinecoltokgenr3r!r"sliner$_r& mark_startpartmark_end tok_classis_start_of_liner*r*r+source_token_linesfsZ        roc@s$eZdZdZd ddZd d d Zd S)CachedTokenizeraXA one-element cache around tokenize.generate_tokens. When reporting, coverage.py tokenizes files twice, once to find the structure of the file, and once to syntax-color it. Tokenizing is expensive, and easily cached. This is a one-element cache so that our twice-in-a-row tokenizing doesn't actually tokenize twice. r r0cCsd|_g|_dSr1) last_text last_tokens)r7r*r*r+r8s zCachedTokenizer.__init__textr/r cCsJ||jkr"||_t|j}z tt||_W|jSd|_|jS)z*A stand-in for `tokenize.generate_tokens`.N)rqioStringIOreadlinelistrrXrr)r7rsrvr*r*r+rXs  zCachedTokenizer.generate_tokensN)r r0)rsr/r r )rIrJrKrLr8rXr*r*r*r+rps rpbytescCst|dj}t|dS)zDetermine the encoding for `source`, according to PEP 263. `source` is a byte string: the text of the program. Returns a string, the name of the encoding. Tr)iter splitlines__next__rdetect_encoding)r.rvr*r*r+source_encodingsr})r r r r )r.r/r r )r.rxr r/)rL __future__rr5rtrar[rMrrtypingrrrrrcoveragercoverage.typesr r rr r, NodeVisitorr-rorprXr}r*r*r*r+s&    7 G