o PFfE@sddlZddlZddlZddlZddlZddlZddlmZddlmZm Z m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZddlmZerzddlmZGdd d e ZeeefZejdd krweeeeeefeeefefZ nej Z d d Z!Gd dde"ddZ#ejdkrej$Z%nGdddZ%dOddZ&dOddZ'ejdkrddZ(nddZ(ddZ)ddZ*dPd d!Z+d"d#eej,DZ-dPd$d%Z.d&d#eej,DZ/d'd#eej,Dhd(BZ0d)d*Z1d+d,Z2d-d.Z3d/d0Z4d1d2Z5d3d4Z6d5d6Z7e8Z9d7d8Z:dPd9d:Z;d;d<Zd>e8Z=ejdd kr'd?d@Z>ndAd@Z>dBdCZ?dDdEZ@ejdd dFkrRddGlAmBZBeBddHdIdJZCdKdLZDdSdMdJZCdNdLZDdS)QN)ABCMeta)ModuleexprAST) CallableDictIterableIteratorListOptionalTupleUnioncastAny TYPE_CHECKING) iteritems)NodeNGc@seZdZdZdZdZdS) EnhancedASTNr)__name__ __module__ __qualname__ first_token last_tokenlinenorrM/var/www/secure340b-portal/env/lib/python3.10/site-packages/asttokens/util.pyr!srcCsdtj|t|dfS)zRReturns a human-friendly representation of a token with the given type and string.z%s:%su)tokentok_namereprlstrip)tok_typestringrrr token_repr/sr%c@seZdZdZddZdS)Tokena TokenInfo is an 8-tuple containing the same 5 fields as the tokens produced by the tokenize module, and 3 additional ones useful for this module: - [0] .type Token type (see token.py) - [1] .string Token (a string) - [2] .start Starting (row, column) indices of the token (a 2-tuple of ints) - [3] .end Ending (row, column) indices of the token (a 2-tuple of ints) - [4] .line Original line (string) - [5] .index Index of the token in the list of tokens that it belongs to. - [6] .startpos Starting character offset into the input text. - [7] .endpos Ending character offset into the input text. cCst|j|jSN)r%typer$selfrrr__str__Dsz Token.__str__N)rrr__doc__r+rrrrr&6s r&z0type string start end line index startpos endpos)c@seZdZeZdS) AstConstantN)rrrobjectvaluerrrrr/Ls r/cCs|j|ko |dup |j|kS)zVReturns true if token is of the given type and, if a string is given, has that string.N)r(r$rr#tok_strrrr match_tokenPsr4cCs>t|||stdt||t||jd|jddfdS)z Verifies that the given token is of the expected type. If tok_str is given, the token string is verified too. If the token doesn't match, raises an informative ValueError. z+Expected token %s, got %s on line %s col %srrN)r4 ValueErrorr%strstartr2rrr expect_tokenVs r8)r-cCs|tjtjtjfvSzW These are considered non-coding tokens, as they don't affect the syntax tree. )rNLCOMMENTENCODING token_typerrris_non_coding_tokendsr@cCs |tjkSr:)rN_TOKENSr>rrrr@ks cCs tttgtft|jS)z; Generates standard library tokens for the given code. )tokenizegenerate_tokensrrr6ioStringIOreadline)textrrrrCss rCcCst|drtStS)z Returns a function which yields all direct children of a AST node, skipping children that are singleton nodes. The function depends on whether ``node`` is from ``ast`` or from the ``astroid`` module. get_children)hasattriter_children_astroiditer_children_astnoderrriter_children_func~srNFcCs|st|rgS|Sr') is_joined_strrH)rMinclude_joined_strrrrrJs rJc Cs<h|]\}}t|trt|tjtjtjtjtjfr|qSr) isinstancer( issubclassast expr_contextboolopoperatorunaryopcmpop.0ncrrr s r]ccsr|s t|r dSt|tjr't|j|jD]\}}|dur!|V|VqdSt|D] }|jt vr6|Vq,dSr') rOrQrSrzipkeysvaluesiter_child_nodes __class__ SINGLETONS)rMrPkeyr1childrrrrKs   rKcC*h|]\}}t|trt|tjr|qSr)rQr(rRrSstmtrYrrrr]   cCrfr)rQr(rRrSrrYrrrr]rh>ConstDelAttrDelName AssignAttr AssignNamecC |jjtvS)z+Returns whether node is an expression node.)rbrexpr_class_namesrLrrris_expr rpcCrn)z)Returns whether node is a statement node.)rbrstmt_class_namesrLrrris_stmtrqrscC |jjdkS)z&Returns whether node is a module node.rrbrrLrrr is_modulerqrvcCrt)zFReturns whether node is a JoinedStr node, used to represent f-strings. JoinedStrrurLrrrrOs rOcCrt)z2Returns whether node is a starred expression node.StarredrurLrrr is_starredrqrycCs0|jjdvp|jjdkotttttj|jS)z?Returns whether node represents a slice, e.g. `1:2` in `x[1:2]`)SliceExtSlicer ) rbranymapis_slicerrSr eltsrLrrrr~s  r~cCsB|jjdko t|tj o |j|juo|juoduSS)Nrz)rbrrQrSrloweruppersteprLrrris_empty_astroid_slices   rcCs|sdd}t|}t}d}|dtfg}|r^|\}}} | turQ||vs(J|||||\} } |||| ft|} ||D] } || | | tfqDn |||tt t | }|s|S)a5 Scans the tree under the node depth-first using an explicit stack. It avoids implicit recursion via the function call stack to avoid hitting 'maximum recursion depth exceeded' error. It calls ``previsit()`` and ``postvisit()`` as follows: * ``previsit(node, par_value)`` - should return ``(par_value, value)`` ``par_value`` is as returned from ``previsit()`` of the parent. * ``postvisit(node, par_value, value)`` - should return ``value`` ``par_value`` is as returned from ``previsit()`` of the parent, and ``value`` is as returned from ``previsit()`` of this node itself. The return ``value`` is ignored except the one for the root node, which is returned from the overall ``visit_tree()`` call. For the initial node, ``par_value`` is None. ``postvisit`` may be None. cSdSr'r)rMpvaluer1rrrszvisit_tree..N) rNset _PREVISITpopaddappendleninsertrr r&)rMprevisit postvisit iter_childrendoneretstackcurrent par_valuer1r post_valueinsr[rrr visit_trees(    rccsnt|}t}|g}|r5|}||vsJ|||Vt|}|||D]}|||q(|s dSdS)a1 Recursively yield all descendant nodes in the tree starting at ``node`` (including ``node`` itself), using depth-first pre-order traversal (yieling parents before their children). This is similar to ``ast.walk()``, but with a different order, and it works for both ``ast`` and ``astroid`` trees. Also, as ``iter_children()``, it skips singleton nodes generated by ``ast``. By default, ``JoinedStr`` (f-string) nodes and their contents are skipped because they previously couldn't be handled. Set ``include_joined_str`` to True to include them. N)rNrrrrr)rMrPrrrrrr\rrrwalks    rcCsXd}g}t|D]\}}}|||||||}q|||dd|S)ah Replaces multiple slices of text with new values. This is a convenience method for making code modifications of ranges e.g. as identified by ``ASTTokens.get_text_range(node)``. Replacements is an iterable of ``(start, end, new_text)`` tuples. For example, ``replace("this is a test", [(0, 4, "X"), (8, 9, "THE")])`` produces ``"X is THE test"``. rN)sortedrjoin)rG replacementsppartsr7endnew_textrrrreplace1s   rc@s eZdZdZddZddZdS) NodeMethodsz[ Helper to get `visit_{node_type}` methods given a node's class and cache the results. cCs i|_dSr')_cacher)rrr__init__Is zNodeMethods.__init__cCs:|j|}|sd|j}t|||j}||j|<|S)z Using the lowercase name of the class as node_type, returns `obj.visit_{node_type}`, or `obj.visit_default` if the type-specific method is not found. visit_)rgetrrgetattr visit_default)r*objclsmethodnamerrrrMs  zNodeMethods.getN)rrrr,rrrrrrrEs rcCst|Sr')iter)original_tokensrrrpatched_generate_tokens^srccs|g}|D],}|jtjtjtjfvr"|r|dj|jkr"||qt|D]}|Vq&g}|Vqt|D]}|Vq6dS)a Fixes tokens yielded by `tokenize.generate_tokens` to handle more non-ASCII characters in identifiers. Workaround for https://github.com/python/cpython/issues/68382. Should only be used when tokenizing a string that is known to be valid syntax, because it assumes that error tokens are not actually errors. Combines groups of consecutive NAME, NUMBER, and/or ERRORTOKEN tokens into a single NAME token. N) r(rBNAME ERRORTOKENNUMBERrr7rcombine_tokens)rgrouptokcombined_tokenrrrrbs    cCsftdd|Drtdd|Ddkr|Stjtjddd|D|dj|d j|djd gS) Ncss|] }|jtjkVqdSr')r(rBrrZrrrr }sz!combine_tokens..cSsh|]}|jqSr)linerrrrr]}sz!combine_tokens..rrcss|]}|jVqdSr')r$)rZtrrrrsrr)r(r$r7rr) r|rrB TokenInforrr7rr)rrrrr{s(rcCs*ddt||D}|rt|dS|S)zq If the given AST node contains multiple statements, return the last one. Otherwise, just return the node. cSs&g|]}t|st|jdvr|qS)) excepthandler ExceptHandler match_case MatchCase TryExcept TryFinally)rsr(r)rZrerrr szlast_stmt..r)rN last_stmt)rM child_stmtsrrrrs   r)r-) lru_cache)maxsizecsbdt}ddt|D}dd|D}tt|t|k}tfdd|D}|o0|S)a The positions attached to nodes inside f-string FormattedValues have some bugs that were fixed in Python 3.9.7 in https://github.com/python/cpython/pull/27729. This checks for those bugs more concretely without relying on the Python version. Specifically this checks: - Values with a format spec or conversion - Repeated (i.e. identical-looking) expressions - f-strings implicitly concatenated over multiple lines. - Multiline, triple-quoted f-strings. z( f"a {b}{b} c {d!r} e {f:g} h {i:{j}} k {l:{m:n}}" f"a {b}{b} c {d!r} e {f:g} h {i:{j}} k {l:{m:n}}" f"{x + y + z} {x} {y} {z} {z} {z!a} {z:z}" f''' {s} {t} {u} {v} ''' )cSsg|] }t|tjr|qSr)rQrSNamerZrMrrrrsz*fstring_positions_work..cSsg|]}|j|jfqSr)r col_offsetrrrrrsc3s"|] }t||jkVqdSr')rSget_source_segmentidrsourcerrrs  z)fstring_positions_work..)rSparserrrall)tree name_nodesname_positionspositions_are_uniquecorrect_source_segmentsrrrfstring_positions_works  rcCstjdkrdSt|ddD]6}t|tjsq |jD])}t|ddt|tjrBt s8t|j D]}t|ddq/|j rBt|j ddqq dS)z Add a special attribute `_broken_positions` to nodes inside f-strings if the lineno/col_offset cannot be trusted. )r- NT)rP_broken_positions) sys version_inforrQrSrwr`setattrFormattedValuerr1 format_spec)r joinedstrpartrerrrannotate_fstring_nodess     rcCsdS)NFrrrrrrcCrr'r)_treerrrrrr')F)ErS collectionsrDrrrBabcrrrrtypingrrrr r r r r rrrsixrastroid_compatrrAstNoderintr6rr% namedtupler&Constantr/r4r8r@rCrNrJ__dict__rcrKrrrorprsrvrOryr~rr0rrrrrrrr functoolsrrrrrrrsx 4   $        +