U
,aQ @ s d Z dZddgZddlZddlZddlZddlZddlZddlm Z m
Z
m Z m Z m
Z
G dd deZd d
ZdddZdd Zdd Zdd Zedkreee dS )zZParser driver.
This provides a high-level interface to parse a file into a syntax tree.
z#Guido van Rossum <guido@python.org>Driver load_grammar N )grammarparsetokentokenizepgenc @ sH e Zd ZdddZdddZdddZdd d
Zdd d Zdd
dZdS )r Nc C s& || _ |d krt }|| _|| _d S )N)r logging getLoggerloggerconvert)selfr r
r r 9/opt/alt/python38/lib64/python3.8/lib2to3/pgen2/driver.py__init__ s
zDriver.__init__Fc C s t | j| j}| d}d}d } } } } }
d} |D ]8} | \}}}} }
|||fkr||f|ksxt||f|f|\}
}||
k r| d|
| 7 } |
}d}||k r| |
|| 7 } |}|tjtjfkr| |7 } | \}}| dr<|d7 }d}q<|t
j kr
tj | }|r(| j
dt
j| || |||| |frT|rN| j
d qd} | \}}| dr<|d7 }d}q<t d||| |f|jS ) z4Parse a series of tokens and return the syntax tree.r r N
z%s %r (prefix=%r)zStop.zincomplete input)r ZParserr r
ZsetupAssertionErrorr COMMENTNLendswithr OPZopmapr debugtok_nameZaddtokenZ
ParseErrorZrootnode)r tokensr plinenocolumntypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_columnr r r parse_tokens& s`
zDriver.parse_tokensc C s t |j}| ||S z*Parse a stream and return the syntax tree.)r generate_tokensreadliner$ )r streamr r r r r parse_stream_rawV s zDriver.parse_stream_rawc C s | ||S r% )r) )r r( r r r r parse_stream[ s zDriver.parse_streamc
C s4 t j|d|d}| ||W 5 Q R S Q R X dS )z(Parse a file and return the syntax tree.r)encodingN)ioopenr* )r filenamer, r r( r r r
parse_file_ s zDriver.parse_filec C s t t|j}| ||S )z*Parse a string and return the syntax tree.)r r& r- StringIOr' r$ )r textr r r r r parse_stringd s zDriver.parse_string)NN)F)F)F)NF)F) __name__
__module__ __qualname__r r$ r) r* r0 r3 r r r r r s
0
c C s: t j| \}}|dkr d}|| dtttj d S )Nz.txtr .z.pickle)ospathsplitextjoinmapstrsys version_info)gtheadtailr r r _generate_pickle_namej s rC Grammar.txtTFc
C s |dkrt }|dkr t| n|}|s2t|| s|d| t| }|r|d| z|| W q tk
r } z|d| W 5 d}~X Y qX nt
}| | |S )z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %sz Writing grammar tables to %szWriting failed: %s) r
r rC _newerinfor Zgenerate_grammardumpOSErrorr Grammarload)r@ Zgpsaveforcer ger r r r q s
c C s8 t j| sdS t j|s dS t j| t j|kS )z0Inquire whether file a was written since file b.FT)r8 r9 existsgetmtime)abr r r rE s
rE c C sF t j|rt|S tt j|}t| |}t }|
| |S )a Normally, loads a pickled grammar by doing
pkgutil.get_data(package, pickled_grammar)
where *pickled_grammar* is computed from *grammar_source* by adding the
Python version and using a ``.pickle`` extension.
However, if *grammar_source* is an extant file, load_grammar(grammar_source)
is called instead. This facilitates using a packaged grammar file when needed
but preserves load_grammar's automatic regeneration behavior when possible.
) r8 r9 isfiler rC basenamepkgutilget_datar rI loads)packageZgrammar_sourceZ pickled_namedatarM r r r load_packaged_grammar s
rZ c G sB | st jdd } tjtjt jdd | D ]}t|ddd q*dS )zMain program, when run as a script: produce grammar pickle files.
Calls load_grammar for each argument, a path to a grammar text file.
r Nz %(message)s)levelr( formatT)rK rL )r> argvr
Z basicConfigINFOstdoutr )argsr@ r r r main s ra __main__)rD NTFN)__doc__
__author____all__r- r8 r
rU r> r r r r r r objectr rC r rE rZ ra r4 exitintr r r r <module> s( M