o bE! @sdZdZddgZddlZddlZddlZddlZddlZddlm Z m Z m Z m Z m Z mZmZmZddlmZmZmZmZmZdd lmZdd lmZmZdd lmZeed fZGd ddeZ d'dede edefddZ!     d(dede ede"de"de edef ddZ#dedede"fddZ$ d'ded ede edejfd!d"Z%d#ede"fd$d%Z&e'd&kre(e)e& dSdS))zZParser driver. This provides a high-level interface to parse a file into a syntax tree. z#Guido van Rossum Driver load_grammarN)AnyIOIterableListOptionalTextTupleUnion)grammarparsetokentokenizepgen)Logger)_ConvertNL)Grammarzos.PathLike[str]c @seZdZ  ddedeedeeddfddZdd ee d e de fd d Z dd e ed e de fddZdd e ed e de fddZ ddedeed e de fddZdded e de fddZdededeeeffddZdS) rNr convertloggerreturncCs(||_|dur tt}||_||_dSN)r logging getLogger__name__rr)selfr rrrT/var/www/secure340b-portal/env/lib/python3.10/site-packages/blib2to3/pgen2/driver.py__init__-s   zDriver.__init__FtokensdebugcCst|j|j}|d}d}g}d}}} } } d} |D]} | \}}} } } | ||fkr_||f| ks=J||f| f| \}}||krQ| d||7} |}d}||kr_| | ||7} |}|tjtjfvr{| |7} | \}}|drz|d7}d}q |t j krtj |}|r|j dt j||| |t jkr|t|| |}d} d}n|t jkr|}|| |\} }|||| | fr|r|j dn,d} |t jt jhvr|} | \}}|dr|d7}d}q | dusJtd||| | f|jdusJ|jS) z4Parse a series of tokens and return the syntax tree.r rN z%s %r (prefix=%r)zStop.zincomplete input)rParserr rsetuprCOMMENTrendswithrOPopmaprr"tok_nameINDENTappendlenDEDENTpop_partially_consume_prefixZaddtoken ParseErrorrootnode)rr!r"plinenocolumnZindent_columnstypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_column_prefixZ _indent_colrrr parse_tokens9sp         zDriver.parse_tokensstreamcCstj|j|jd}|||S)*Parse a stream and return the syntax tree.r )rgenerate_tokensreadliner r=)rr>r"r!rrrparse_stream_rawvs zDriver.parse_stream_rawcCs |||S)r?)rC)rr>r"rrr parse_stream{s zDriver.parse_streamfilenameencodingcCs@tj|d|d}|||WdS1swYdS)z(Parse a file and return the syntax tree.r)rFN)ioopenrD)rrErFr"r>rrr parse_files $zDriver.parse_filetextcCs$tjt|j|jd}|||S)z*Parse a string and return the syntax tree.r@)rrArHStringIOrBr r=)rrKr"r!rrr parse_strings zDriver.parse_stringr;r6c Csg}d}d}d}|D]C}||7}|r;|dkr:|r/||kr/d|}||t|dfS||d}d}d}q |dvrD|d7}q |dkrKd}q d}q d||fS)Nr#rFr$z r T)stripjoinr.r-) rr;r6lines current_lineZcurrent_columnZ wait_for_nlcharresrrrr1s,   z Driver._partially_consume_prefix)NN)F)NF)r __module__ __qualname__rrrrr rrboolrr=rr rCrDPathrJrMintr r1rrrrr,s6  = "gt cache_dirrcCsXtj|\}}|dkrd}||dtttjd}|r*tj|tj|S|S)Nz.txtr#.z.pickle) ospathsplitextrOmapstrsys version_infobasename)rYrZheadtailnamerrr_generate_pickle_namesrg Grammar.txtTFgpsaveforcerc Cs|dur tt}|durt|n|}|st||sQ|d|t|}|rO|d|z||W|St yN}z |d|WYd}~|Sd}~ww|St }| ||S)z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %szWriting grammar tables to %szWriting failed: %s) rrrrg_newerinforZgenerate_grammardumpOSErrorr rload)rYrirjrkrgerrrrs(      abcCs8tj|sdStj|sdStj|tj|kS)z0Inquire whether file a was written since file b.FT)r\r]existsgetmtime)rsrtrrrrls  rlpackagegrammar_sourcecCsjtj|r|r t||nd}t||dSttj||}t||}|dus*Jt }| ||S)aNormally, loads a pickled grammar by doing pkgutil.get_data(package, pickled_grammar) where *pickled_grammar* is computed from *grammar_source* by adding the Python version and using a ``.pickle`` extension. However, if *grammar_source* is an extant file, load_grammar(grammar_source) is called instead. This facilitates using a packaged grammar file when needed but preserves load_grammar's automatic regeneration behavior when possible. N)ri) r\r]isfilergrrcpkgutilget_datar rloads)rwrxrZriZ pickled_namedatarqrrrload_packaged_grammars     r~argscGsF|s ttjdd}tjtjtjdd|D] }t|dddqdS)zMain program, when run as a script: produce grammar pickle files. Calls load_grammar for each argument, a path to a grammar text file. r Nz %(message)s)levelr>formatT)rjrk)tupleraargvr basicConfigINFOstdoutr)rrYrrrmains r__main__r)rhNTFN)*__doc__ __author____all__rHr\rrzratypingrrrrrr r r r#r rrrrrZblib2to3.pytreerrZblib2to3.pgen2.grammarrr`rWobjectrrgrVrrlr~rrexitrXrrrrsb(   }