YfY @ s d Z d Z d d g Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z m
Z
m Z m Z m
Z
Gd d d e Z d d
Z d d d d
d d d Z d d Z d d Z e d k r e j e e d S)zZParser driver.
This provides a high-level interface to parse a file into a syntax tree.
z#Guido van Rossum <guido@python.org>Driver load_grammar N )grammarparsetokentokenizepgenc @ sp e Z d Z d d d d Z d d d Z d d d Z d d d
Z d d d d Z d d
d Z d S)r Nc C s7 | | _ | d k r! t j } | | _ | | _ d S)N)r logging getLoggerloggerconvert)selfr r
r r 9/opt/alt/python35/lib64/python3.5/lib2to3/pgen2/driver.py__init__ s
zDriver.__init__Fc C s" t j | j | j } | j d } d } d } } } } }
d } x| D]} | \ } } } } }
| | | f k r| | f | k s t | | f | f | \ }
} | |
k r | d |
| 7} |
} d } | | k r| |
| | 7} | } | t j t j f k rT| | 7} | \ } } | j d rQ | d 7} d } qQ | t
j k rpt j | } | r| j
j d t
j | | | | j | | | | f r| r| j
j d Pd } | \ } } | j d rQ | d 7} d } qQ Wt j d | | | | f | j S) z4Parse a series of tokens and return the syntax tree.r r N
z%s %r (prefix=%r)zStop.zincomplete input)r ZParserr r
ZsetupAssertionErrorr COMMENTNLendswithr OPZopmapr debugtok_nameZaddtokenZ
ParseErrorZrootnode)r tokensr plinenocolumntypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_columnr r r parse_tokens& sT
*
zDriver.parse_tokensc C s" t j | j } | j | | S)z*Parse a stream and return the syntax tree.)r generate_tokensreadliner$ )r streamr r r r r parse_stream_rawV s zDriver.parse_stream_rawc C s | j | | S)z*Parse a stream and return the syntax tree.)r( )r r' r r r r parse_stream[ s zDriver.parse_streamc
C s; t j | d | } z | j | | SWd | j Xd S)z(Parse a file and return the syntax tree.rN)codecsopenr) close)r filenameencodingr r' r r r
parse_file_ s zDriver.parse_filec C s+ t j t j | j } | j | | S)z*Parse a string and return the syntax tree.)r r% ioStringIOr& r$ )r textr r r r r parse_stringg s zDriver.parse_string) __name__
__module__ __qualname__r r$ r( r) r0 r4 r r r r r s 0c C sO t j j | \ } } | d k r* d } | | d j t t t j d S)Nz.txtr .z.pickle)ospathsplitextjoinmapstrsys version_info)gtheadtailr r r _generate_pickle_namem s rD z Grammar.txtTFc C s | d k r t j } | d k r0 t | n | } | sL t | | r | j d | t j | } | r | j d | y | j | Wq t k
r } z | j d | WYd d } ~ Xq Xn t j
} | j | | S)z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %sz Writing grammar tables to %szWriting failed: %s) r
r rD _newerinfor Zgenerate_grammardumpOSErrorr ZGrammarload)rA Zgpsaveforcer ger r r r t s &
c C sN t j j | s d St j j | s, d St j j | t j j | k S)z0Inquire whether file a was written since file b.FT)r9 r: existsgetmtime)abr r r rE s
rE c G sf | s t j d d } t j d t j d t j d d x$ | D] } t | d d d d qB Wd S)
zMain program, when run as a script: produce grammar pickle files.
Calls load_grammar for each argument, a path to a grammar text file.
r Nlevelr' formatz %(message)srJ TrK )r? argvr
Z basicConfigINFOstdoutr )argsrA r r r main s
rX __main__)__doc__
__author____all__r+ r1 r9 r
r? r r r r r r objectr rD r rE rX r5 exitintr r r r <module> s (P