Viewing File: /usr/lib/python2.7/site-packages/jmespath/parser.pyo
ó
QŒYc @ s˜ d Z d d l Z d d l m Z d d l m Z d d l m Z d d l m Z d d l m Z d e f d „ ƒ YZ
e d
e f d „ ƒ Yƒ Z d S( s‹ Top down operator precedence parser.
This is an implementation of Vaughan R. Pratt's
"Top Down Operator Precedence" parser.
(http://dl.acm.org/citation.cfm?doid=512927.512931).
These are some additional resources that help explain the
general idea behind a Pratt parser:
* http://effbot.org/zone/simple-top-down-parsing.htm
* http://javascript.crockford.com/tdop/tdop.html
A few notes on the implementation.
* All the nud/led tokens are on the Parser class itself, and are dispatched
using getattr(). This keeps all the parsing logic contained to a single
class.
* We use two passes through the data. One to create a list of token,
then one pass through the tokens to create the AST. While the lexer actually
yields tokens, we convert it to a list so we can easily implement two tokens
of lookahead. A previous implementation used a fixed circular buffer, but it
was significantly slower. Also, the average jmespath expression typically
does not have a large amount of token so this is not an issue. And
interestingly enough, creating a token list first is actually faster than
consuming from the token iterator one token at a time.
iÿÿÿÿN( t lexer( t with_repr_method( t ast( t
exceptions( t visitort Parserc B sÅ e Z i d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d
6d d 6d d 6d
d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d 6d d! 6d" d# 6d$ d% 6d& d' 6d( d) 6Z d* Z i Z d+ Z d d, „ Z d- „ Z d. „ Z d/ „ Z d d0 „ Z
d1 „ Z d2 „ Z d3 „ Z
d4 „ Z d5 „ Z d6 „ Z d7 „ Z d8 „ Z d9 „ Z d: „ Z d; „ Z d< „ Z d= „ Z d> „ Z d? „ Z d@ „ Z dA „ Z dB „ Z dC „ Z dD „ Z dE „ Z dF „ Z dG „ Z! dH „ Z" dI „ Z# dJ „ Z$ dK „ Z% dL „ Z& dM „ Z' dN „ Z( dO „ Z) dP „ Z* dQ „ Z+ dR „ Z, dS „ Z- dT „ Z. d_ dU „ Z0 dV „ Z1 dW „ Z2 dX „ Z3 dY „ Z4 dZ „ Z5 d[ „ Z6 d\ „ Z7 d] „ Z8 e9 d^ „ ƒ Z: RS(` i t eoft unquoted_identifiert quoted_identifiert literalt rbrackett rparent commat rbracet numbert currentt expreft coloni t pipei t ori t andi t eqt gtt ltt gtet ltet nei t flatteni t stari t filteri( t doti- t noti2 t lbracei7 t lbracketi< t lpareni
i€ c C s/ d | _ d g | | _ | | _ d | _ d S( Ni ( t Nonet tokenizert _tokenst _buffer_sizet _index( t selft lookahead( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt __init__N s c C sg | j j | ƒ } | d k r" | S| j | ƒ } | | j | <t | j ƒ | j k rc | j ƒ n | S( N( t _CACHEt getR# t _do_parset lent _MAX_SIZEt _free_cache_entries( R( t
expressiont cachedt
parsed_result( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt parseT s
c C s€ y | j | ƒ SWnh t j k
r5 } | | _ ‚ nG t j k
rZ } | j | ƒ ‚ n" t j k
r{ } | | _ ‚ n Xd S( N( t _parseR t
LexerErrorR1 t IncompleteExpressionErrort set_expressiont
ParseError( R( R1 t e( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyR- ^ s
c C s¢ t j ƒ j | ƒ | _ t | j ƒ | _ d | _ | j d d ƒ } | j ƒ d k s• | j d ƒ } t
j | d | d | d d | d ƒ ‚ n t | | ƒ S( Ni t
binding_powerR t startt valuet types Unexpected token: %s(
R t Lexert tokenizeR$ t listR% R' t _expressiont _current_tokent _lookahead_tokenR R9 t ParsedResult( R( R1 t parsedt t( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyR5 k s c C sÏ | j d ƒ } | j ƒ t | d | d | j ƒ } | | ƒ } | j ƒ } xz | | j | k rÊ t | d | d ƒ } | d k r¥ | j d ƒ } | j | ƒ qQ | j ƒ | | ƒ } | j ƒ } qQ W| S( Ni s
_token_nud_%sR> s
_token_led_%s( RD t _advancet getattrt _error_nud_tokenRC t
BINDING_POWERR# t _error_led_token( R( R; t
left_tokent nud_functiont leftt
current_tokent ledt error_token( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRB v s
c C s t j | d ƒ S( NR= ( R R ( R( t token( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_literal‰ s c C s t j | d ƒ S( NR= ( R t field( R( RS ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_unquoted_identifierŒ s c C s[ t j | d ƒ } | j ƒ d k rW | j d ƒ } t j d | d | d d ƒ ‚ n | S( NR= R" i R> s1 Quoted identifier not allowed for function names.( R RU RC RD R R9 ( R( RS RU RG ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_quoted_identifier s c C sS t j ƒ } | j ƒ d k r- t j ƒ } n | j | j d ƒ } t j | | ƒ S( NR
R ( R t identityRC t _parse_projection_rhsRK t value_projection( R( RS RO t right( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_starš s
c C s | j t j ƒ ƒ S( N( t _token_led_filterR RX ( R( RS ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_filter¢ s c C s
| j ƒ S( N( t _parse_multi_select_hash( R( RS ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_lbrace¥ s c C s | j ƒ } | j d ƒ | S( NR ( RB t _match( R( RS R1 ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_lparen¨ s
c C s; t j t j ƒ ƒ } | j | j d ƒ } t j | | ƒ S( NR ( R R RX RY RK t
projection( R( RS RO R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_flatten s c C s# | j | j d ƒ } t j | ƒ S( NR ( RB RK R t not_expression( R( RS t expr( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_not³ s c C s© | j ƒ d k r4 | j ƒ } | j t j ƒ | ƒ S| j ƒ d k r› | j d ƒ d k r› | j ƒ | j ƒ | j | j d ƒ } t j t j ƒ | ƒ S| j
ƒ Sd S( NR R R i R
( s numberR ( RC t _parse_index_expressiont _project_if_sliceR RX t
_lookaheadRH RY RK Rc t _parse_multi_select_list( R( RS R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_lbracket· s
c C so | j d ƒ d k s* | j d ƒ d k r4 | j ƒ St j | j d ƒ d ƒ } | j ƒ | j d ƒ | Sd S( Ni R i R= R
( Rj t _parse_slice_expressionR t indexRD RH Ra ( R( t node( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRh È s
c C sû d d d g } d } | j ƒ } x½ | d k rà | d k rà | d k rˆ | d 7} | d k r{ | j | j d ƒ d ƒ n | j ƒ nI | d k r¸ | j d ƒ d | | <| j ƒ n | j | j d ƒ d ƒ | j ƒ } q$ W| j d ƒ t j | Œ S( Ni R
i R i s syntax errorR R= ( R# RC t _raise_parse_error_for_tokenRD RH Ra R t slice( R( t partsRn RP ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRm × s$
c C s
t j ƒ S( N( R t current_node( R( RS ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_currentï s c C s# | j | j d ƒ } t j | ƒ S( NR ( RB RK R R ( R( RS R1 ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_nud_exprefò s c C s— | j ƒ d k sc | j | j d ƒ } | d d k rM | d j | ƒ | St j | | g ƒ Sn0 | j ƒ | j | j d ƒ } t j | | ƒ Sd S( NR R R> t
subexpressiont children( RC t _parse_dot_rhsRK t appendR Rv RH RY RZ ( R( RO R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_led_dotö s
c C s& | j | j d ƒ } t j | | ƒ S( NR ( RB RK R R ( R( RO R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_led_pipe s c C s& | j | j d ƒ } t j | | ƒ S( NR ( RB RK R t
or_expression( R( RO R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt
_token_led_or s c C s& | j | j d ƒ } t j | | ƒ S( NR ( RB RK R t and_expression( R( RO R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_led_and
s c C sÕ | d d k rN | j d ƒ } t j | d | d | d d | d ƒ ‚ n | d } g } xQ | j ƒ d k s± | j ƒ } | j ƒ d k r¡ | j d ƒ n | j | ƒ qa W| j d ƒ t j | | ƒ } | S( NR> RU iþÿÿÿR< R= s Invalid function name '%s'R R ( RD R R9 RC RB Ra Ry R t function_expression( R( RO t prev_tt namet argsR1 t
function_node( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_led_lparen s
c C sf | j d ƒ } | j d ƒ | j ƒ d k r= t j ƒ } n | j | j d ƒ } t j | | | ƒ S( Ni R
R R ( RB Ra RC R RX RY RK t filter_projection( R( RO t conditionR[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyR] % s
c C s | j | d ƒ S( NR ( t _parse_comparator( R( RO ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt
_token_led_eq/ s c C s | j | d ƒ S( NR ( Rˆ ( R( RO ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt
_token_led_ne2 s c C s | j | d ƒ S( NR ( Rˆ ( R( RO ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt
_token_led_gt5 s c C s | j | d ƒ S( NR ( Rˆ ( R( RO ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_led_gte8 s c C s | j | d ƒ S( NR ( Rˆ ( R( RO ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt
_token_led_lt; s c C s | j | d ƒ S( NR ( Rˆ ( R( RO ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_led_lte> s c C s5 t j | ƒ } | j | j d ƒ } t j | | ƒ S( NR ( R R RY RK Rc ( R( RO R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_led_flattenA s c C s§ | j d ƒ } | d d k rc | j ƒ } | d d k rP | d j | ƒ | S| j | | ƒ Sn@ | j d ƒ | j d ƒ | j | j d ƒ } t j | | ƒ Sd S(
Ni R> R R t index_expressionRw R R
( s numbers colon( RD Rh Ry Ri Ra RY RK R Rc ( R( RO RS R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _token_led_lbracketG s
c C sM t j | | g ƒ } | d d k rE t j | | j | j d ƒ ƒ S| Sd S( NR> Rq R ( R R Rc RY RK ( R( RO R[ t
index_expr( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRi Z s c C s) | j | j | ƒ } t j | | | ƒ S( N( RB RK R t
comparator( R( RO R“ R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRˆ c s c C si g } xF t rN | j ƒ } | j | ƒ | j ƒ d k r> Pq | j d ƒ q W| j d ƒ t j | ƒ S( NR
R ( t TrueRB Ry RC Ra R t multi_select_list( R( t expressionsR1 ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRk g s
c C sØ g } x¿ t rÇ | j d ƒ } | j d d d g ƒ | d } | j d ƒ | j d ƒ } t j d | d | ƒ } | j | ƒ | j ƒ d k r¡ | j d ƒ q | j ƒ d
k r | j d
ƒ Pq q Wt j d | ƒ S( Ni t token_typesR R R= R t key_nameRo R R
t nodes(
R” RD t _match_multiple_tokensRa RB R t key_val_pairRy RC t multi_select_dict( R( t pairst key_tokenR˜ R= Ro ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyR_ s s
c C sÁ | j | j ƒ | j k r+ t j ƒ } n’ | j ƒ d k rO | j | ƒ } nn | j ƒ d k rs | j | ƒ } nJ | j ƒ d k r¤ | j d ƒ | j | ƒ } n | j | j d ƒ d ƒ | S( NR! R R i s syntax error(
RK RC t _PROJECTION_STOPR RX RB Ra Rx Rp RD ( R( R; R[ ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRY ‡ s
c C s´ | j ƒ } | d k r% | j | ƒ S| d k rH | j d ƒ | j ƒ S| d k rk | j d ƒ | j ƒ S| j d ƒ } d d d d g } d | | d f } | j | | ƒ d S(
NR R R R! R i s Expecting: %s, got: %sR> ( s quoted_identifiers unquoted_identifiers star( RC RB Ra Rk R_ RD Rp ( R( R; R) RG t allowedt msg( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRx ˜ s
c C sH | d d k r4 t j | d | d | d ƒ ‚ n | j | d ƒ d S( NR> R R< R= s
invalid token( R R7 Rp ( R( RS ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRJ ´ s c C s | j | d ƒ d S( Ns
invalid token( Rp ( R( RS ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRL º s c C s< | j ƒ | k r | j ƒ n | j | | j d ƒ ƒ d S( Ni ( RC RH t _raise_parse_error_maybe_eofRD ( R( t
token_type( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRa ½ s
c C s< | j ƒ | k r. | j | | j d ƒ ƒ n | j ƒ d S( Ni ( RC R¢ RD RH ( R( R— ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRš Æ s c C s | j d 7_ d S( Ni ( R' ( R( ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRH Ì s c C s | j | j d S( NR> ( R% R' ( R( ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRC Ï s c C s | j | j | d S( NR> ( R% R' ( R( R ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRj Ò s c C s | j | j | S( N( R% R' ( R( R ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRD Õ s c C s: | d } | d } | d } t j | | | | ƒ ‚ d S( NR< R= R> ( R R9 ( R( RS t reasont lex_positiont actual_valuet actual_type( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRp Ø s
c C sn | d } | d } | d } | d k rB t j | | | ƒ ‚ n d | | f } t j | | | | ƒ ‚ d S( NR< R= R> R s Expecting: %s, got: %s( R R7 R9 ( R( t
expected_typeRS R¥ R¦ R§ t message( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyR¢ ß s
c C sA x: t j | j j ƒ t | j d ƒ ƒ D] } | j | =q) Wd S( Ni ( t randomt sampleR+ t keyst intR/ ( R( t key( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyR0 ë s /c C s | j j ƒ d S( s' Clear the expression compilation cache.N( R+ t clear( t cls( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt purgeï s N(; t __name__t
__module__RK RŸ R+ R/ R* R4 R- R5 RB RT RV RW R\ R^ R` Rb Rd Rg Rl Rh Rm Rt Ru Rz R{ R} R R… R] R‰ RŠ R‹ RŒ R RŽ R R‘ Ri Rˆ Rk R_ RY Rx RJ RL R# Ra Rš RH RC Rj RD Rp R¢ R0 t classmethodR± ( ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyR % s¨
RE c B s/ e Z d „ Z d d „ Z d „ Z d „ Z RS( c C s | | _ | | _ d S( N( R1 RF ( R( R1 RF ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyR* ÷ s c C s( t j | ƒ } | j | j | ƒ } | S( N( R t TreeInterpretert visitRF ( R( R= t optionst interpretert result( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt searchû s c C s" t j ƒ } | j | j ƒ } | S( sf Render the parsed AST as a dot file.
Note that this is marked as an internal method because
the AST is an implementation detail and is subject
to change. This method can be used to help troubleshoot
or for development purposes, but is not considered part
of the public supported API. Use at your own risk.
( R t GraphvizVisitorR¶ RF ( R( t renderert contents( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt _render_dot_file s
c C s
t | j ƒ S( N( t reprRF ( R( ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt __repr__ s N( R² R³ R* R# Rº R¾ RÀ ( ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyRE õ s ( t __doc__Rª t jmespathR t jmespath.compatR R R R t objectR RE ( ( ( s3 /usr/lib/python2.7/site-packages/jmespath/parser.pyt <module> s ÿ Ñ
Back to Directory
File Manager