U
,aQ @ s d Z dZddgZddlZddlZddlZddlZddlZddlm Z m
Z
m Z m Z m
Z
G dd deZd d
ZdddZdd Zdd Zdd Zedkreee dS )zZParser driver.
This provides a high-level interface to parse a file into a syntax tree.
z#Guido van Rossum <guido@python.org>Driver load_grammar N )grammarparsetokentokenizepgenc @ sH e Zd ZdddZdddZdddZdd d
Zdd d Zdd
dZdS )r Nc C s& || _ |d krt }|| _|| _d S )N)r logging getLoggerloggerconvert)selfr r
r r 9/opt/alt/python38/lib64/python3.8/lib2to3/pgen2/driver.py__init__ s
zDriver.__init__Fc C st t | j| j}| d}d}d } } } } }
d} |D ]} | \}}}} }
|||fkr|\}
}||
k r| d|
| 7 } |
}d}||k r| |
|| 7 } |}|tjtjfkr| |7 } | \}}|dr<|d7 }d}q<|t j
krtj | }|r
| j
dt j| || |||| |fr6|r0| j
d qnd} | \}}|dr<|d7 }d}q<t d||| |f|jS ) z4Parse a series of tokens and return the syntax tree.r r N
z%s %r (prefix=%r)zStop.zincomplete input)r ZParserr r
Zsetupr COMMENTNLendswithr OPZopmapr debugtok_nameZaddtokenZ
ParseErrorZrootnode)r tokensr plinenocolumntypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_columnr r r parse_tokens& s^
zDriver.parse_tokensc C s t |j}| ||S z*Parse a stream and return the syntax tree.)r generate_tokensreadliner# )r streamr r r r r parse_stream_rawV s zDriver.parse_stream_rawc C s | ||S r$ )r( )r r' r r r r parse_stream[ s zDriver.parse_streamc
C s4 t j|d|d}| ||W 5 Q R S Q R X dS )z(Parse a file and return the syntax tree.r)encodingN)ioopenr) )r filenamer+ r r' r r r
parse_file_ s zDriver.parse_filec C s t t|j}| ||S )z*Parse a string and return the syntax tree.)r r% r, StringIOr& r# )r textr r r r r parse_stringd s zDriver.parse_string)NN)F)F)F)NF)F) __name__
__module__ __qualname__r r# r( r) r/ r2 r r r r r s
0
c C s: t j| \}}|dkr d}|| dtttj d S )Nz.txtr .z.pickle)ospathsplitextjoinmapstrsys version_info)gtheadtailr r r _generate_pickle_namej s rB Grammar.txtTFc
C s |dkrt }|dkr t| n|}|s2t|| s|d| t| }|r|d| z|| W q tk
r } z|d| W 5 d}~X Y qX nt
}| | |S )z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %sz Writing grammar tables to %szWriting failed: %s) r
r rB _newerinfor Zgenerate_grammardumpOSErrorr Grammarload)r? Zgpsaveforcer ger r r r q s
c C s8 t j| sdS t j|s dS t j| t j|kS )z0Inquire whether file a was written since file b.FT)r7 r8 existsgetmtime)abr r r rD s
rD c C sF t j|rt|S tt j|}t| |}t }|
| |S )a Normally, loads a pickled grammar by doing
pkgutil.get_data(package, pickled_grammar)
where *pickled_grammar* is computed from *grammar_source* by adding the
Python version and using a ``.pickle`` extension.
However, if *grammar_source* is an extant file, load_grammar(grammar_source)
is called instead. This facilitates using a packaged grammar file when needed
but preserves load_grammar's automatic regeneration behavior when possible.
) r7 r8 isfiler rB basenamepkgutilget_datar rH loads)packageZgrammar_sourceZ pickled_namedatarL r r r load_packaged_grammar s
rY c G sB | st jdd } tjtjt jdd | D ]}t|ddd q*dS )zMain program, when run as a script: produce grammar pickle files.
Calls load_grammar for each argument, a path to a grammar text file.
r Nz %(message)s)levelr' formatT)rJ rK )r= argvr
Z basicConfigINFOstdoutr )argsr? r r r main s r` __main__)rC NTFN)__doc__
__author____all__r, r7 r
rT r= r r r r r r objectr rB r rD rY r` r3 exitintr r r r <module> s( M