Viewing File: /opt/alt/python35/lib64/python3.5/http/__pycache__/cookiejar.cpython-35.pyc



Yf,@sdZddddddddgZd	d
lZd	d
lZd	d
lZd	d
lZd	d
lZd	d
lZyd	d
l	Z
Wnek
rd	d
lZ
YnXd	d
l
Zd	dlmZdZd
ad
dZeejjZdZddZdZddZdddddddgZddddd d!d"d#d$d%d&d'gZgZx!eD]Zej ej!qYWd
d(d)Z"d
d*d+Z#d,d
d-d
d.d
d/d
iZ$ej%d0ej&Z'd1d2Z(d3d4Z)ej%d5ej&Z*ej%d6ej+ej&BZ,ej%d7ej-ej&BZ.d8d9Z/ej%d:ej-ej&BZ0d;d<Z1d=d>Z2ej%d?Z3ej%d@Z4ej%dAZ5ej%dBZ6dCdDZ7ej%dEZ8dFdGZ9dHdIZ:dJdKZ;ej%dLej&Z<dMdNZ=dOdPZ>dQdRZ?dSdTZ@ej%dUej&ZAdVdWZBdXdYZCdZd[ZDd\d]ZEd^ZFej%d_ZGd`daZHdbdcZIdddeZJdfdgZKGdhddZLGdiddZMGdjddeMZNdkdlZOdmdnZPGdodpdpZQGdqddZRGdrddeSZTGdsddeRZUdtduZVGdvddeUZWGdwddeUZXd
S)xaHTTP cookie handling for web clients.

This module has (now fairly distant) origins in Gisle Aas' Perl module
HTTP::Cookies, from the libwww-perl library.

Docstrings, comments and debug strings in this code refer to the
attributes of the HTTP cookie system as cookie-attributes, to distinguish
them clearly from Python attributes.

Class diagram (note that BSDDBCookieJar and the MSIE* classes are not
distributed with the Python standard library, but are available from
http://wwwsearch.sf.net/):

                        CookieJar____
                        /     \      \
            FileCookieJar      \      \
             /    |   \         \      \
 MozillaCookieJar | LWPCookieJar \      \
                  |               |      \
                  |   ---MSIEBase |       \
                  |  /      |     |        \
                  | /   MSIEDBCookieJar BSDDBCookieJar
                  |/
               MSIECookieJar

Cookie	CookieJarCookiePolicyDefaultCookiePolicy
FileCookieJarLWPCookieJar	LoadErrorMozillaCookieJarN)timegmFcGs8ts
dSts+ddl}|jdatj|S)Nr	zhttp.cookiejar)debugloggerloggingZ	getLogger)argsr
r3/opt/alt/python35/lib64/python3.5/http/cookiejar.py_debug.srzQa filename was not supplied (nor was the CookieJar instance initialised with one)cCsgddl}ddl}ddl}|j}|jd||j}|jd|dddS)Nr	zhttp.cookiejar bug!
%s
stacklevel)iowarnings	tracebackStringIO	print_excgetvaluewarn)rrrfmsgrrr_warn_unhandled_exception<s
$ricCs|dd\}}}}}}|tkrd|koEdknrd|koadknrd|ko}dknrd|kodknrd|kodknrt|SdSdS)	Nr	;=)
EPOCH_YEARr
)ttyearmonthZmdayhourminsecrrr_timegmKs
"DT
r,ZMonZTueZWedZThuZFriZSatZSunZJanZFebZMarZAprZMayZJunZJulZAugZSepZOctZNovZDeccCs\|dkrtjj}ntjj|}d|j|j|j|j|j|jfS)aHReturn a string representing time in seconds since epoch, t.

    If the function is called without an argument, it will use the current
    time.

    The format of the returned string is like "YYYY-MM-DD hh:mm:ssZ",
    representing Universal Time (UTC, aka GMT).  An example of this format is:

    1994-11-24 08:49:37Z

    Nz%04d-%02d-%02d %02d:%02d:%02dZ)	datetimeutcnowutcfromtimestampr'r(dayr)minutesecond)tdtrrr	time2isozYs
r5cCsq|dkrtjj}ntjj|}dt|j|jt|jd|j|j	|j
|jfS)zReturn a string representing time in seconds since epoch, t.

    If the function is called without an argument, it will use the current
    time.

    The format of the returned string is like this:

    Wed, DD-Mon-YYYY HH:MM:SS GMT

    Nz#%s, %02d-%s-%04d %02d:%02d:%02d GMTr)r-r.r/DAYSZweekdayr0MONTHSr(r'r)r1r2)r3r4rrr
time2netscapels!r8ZGMTUTCZUTZz^([-+])?(\d\d?):?(\d\d)?$cCsd}|tkrd}nvtj|}|rdt|jd}|jdru|dt|jd}|jddkr|}|S)Nr	ir<r-)	UTC_ZONESTIMEZONE_REsearchintgroup)tzoffsetmrrroffset_from_tz_strings	rFc
Cst|}|tjkrdSytj|jd}Wndtk
ryt|}Wntk
rtdSYnXd|kodknr|}ndSYnX|dkrd}|dkrd}|dkrd}t|}t|}t|}t|}|dkrtjtjd}|d}	|}
|||	}|	|
}	t	|	dkr|	dkr|d}n
|d}t
|||||||f}|dk	r|dkrd}|j}t|}|dkrdS||}|S)Nrr r	id2r9)
rAr-ZMAXYEARMONTHS_LOWERindexlower
ValueErrortimeZ	localtimeabsr,upperrF)
r0monyrhrr*r+rCZimonZcur_yrrEZtmpr3rDrrr	_str2timesV

			



!
rSzV^[SMTWF][a-z][a-z], (\d\d) ([JFMASOND][a-z][a-z]) (\d\d\d\d) (\d\d):(\d\d):(\d\d) GMT$z+^(?:Sun|Mon|Tue|Wed|Thu|Fri|Sat)[a-z]*,?\s*a^
    (\d\d?)            # day
       (?:\s+|[-\/])
    (\w+)              # month
        (?:\s+|[-\/])
    (\d+)              # year
    (?:
          (?:\s+|:)    # separator before clock
       (\d\d?):(\d\d)  # hour:min
       (?::(\d\d))?    # optional seconds
    )?                 # optional clock
       \s*
    ([-+]?\d{2,4}|(?![APap][Mm]\b)[A-Za-z]+)? # timezone
       \s*
    (?:\(\w+\))?       # ASCII representation of timezone in parens.
       \s*$cCs4tj|}|r|j}tj|djd}t|d|t|dt|dt|dt|df}t|S|j	}t
jd|d}dgd	\}}}}}}	}
tj|}|dk	r|j\}}}}}}	}
ndSt
||||||	|
S)
aReturns time in seconds since epoch of time represented by a string.

    Return value is an integer.

    None is returned if the format of str is unrecognized, the time is outside
    the representable range, or the timezone string is not recognized.  If the
    string contains no timezone, UTC is assumed.

    The timezone in the string may be numerical (like "-0800" or "+0100") or a
    string timezone (like "UTC", "GMT", "BST" or "EST").  Currently, only the
    timezone strings equivalent to UTC (zero offset) are known to the function.

    The function loosely parses the following formats:

    Wed, 09 Feb 1994 22:23:32 GMT       -- HTTP format
    Tuesday, 08-Feb-94 14:15:29 GMT     -- old rfc850 HTTP format
    Tuesday, 08-Feb-1994 14:15:29 GMT   -- broken rfc850 HTTP format
    09 Feb 1994 22:23:32 GMT            -- HTTP format (no weekday)
    08-Feb-94 14:15:29 GMT              -- rfc850 format (no weekday)
    08-Feb-1994 14:15:29 GMT            -- broken rfc850 format (no weekday)

    The parser ignores leading and trailing whitespace.  The time may be
    absent.

    If the year is given with only 2 digits, the function will select the
    century that makes the year closest to the current date.

    rrr	r;N)STRICT_DATE_REr@groupsrIrJrKrAfloatr,lstrip
WEEKDAY_REsubLOOSE_HTTP_DATE_RErS)textrEgrPr&r0rQrRr*r+rCrrr	http2times-
"$raa^
    (\d{4})              # year
       [-\/]?
    (\d\d?)              # numerical month
       [-\/]?
    (\d\d?)              # day
   (?:
         (?:\s+|[-:Tt])  # separator before clock
      (\d\d?):?(\d\d)    # hour:min
      (?::?(\d\d(?:\.\d*)?))?  # optional seconds (and fractional)
   )?                    # optional clock
      \s*
   ([-+]?\d\d?:?(:?\d\d)?
    |Z|z)?               # timezone  (Z is "zero meridian", i.e. GMT)
      \s*$c
Cs|j}dgd\}}}}}}}tj|}|dk	rp|j\}}}}}}}}	ndSt|||||||S)av
    As for http2time, but parses the ISO 8601 formats:

    1994-02-03 14:15:29 -0100    -- ISO 8601 format
    1994-02-03 14:15:29          -- zone is optional
    1994-02-03                   -- only date
    1994-02-03T14:15:29          -- Use T as separator
    19940203T141529Z             -- ISO 8601 compact format
    19940203                     -- only date

    NrW)r[ISO_DATE_REr@rYrS)
r_r0rPrQrRr*r+rCrE_rrriso2time's
"'rdcCs7|jd\}}|jd||j|dS)z)Return unmatched part of re.Match object.r	N)spanstring)matchstartendrrr	unmatchedHsrjz^\s*([^=\s;,]+)z&^\s*=\s*\"([^\"\\]*(?:\\.[^\"\\]*)*)\"z^\s*=\s*([^\s;,]*)z\\(.)c
Cst|tstg}x|D]}|}g}xg|rtj|}|rt|}|jd}tj|}|rt|}|jd}tj	d|}nEt
j|}|rt|}|jd}|j}nd}|j||fq8|j
jdrU|j
dd}|rL|j|g}q8tjdd|\}}	|	dkstd|||f|}q8W|r#|j|q#W|S)	amParse header values into a list of lists containing key,value pairs.

    The function knows how to deal with ",", ";" and "=" as well as quoted
    values after "=".  A list of space separated tokens are parsed as if they
    were separated by ";".

    If the header_values passed as argument contains multiple values, then they
    are treated as if they were a single value separated by comma ",".

    This means that this function is useful for parsing header fields that
    follow this syntax (BNF as from the HTTP/1.1 specification, but we relax
    the requirement for tokens).

      headers           = #header
      header            = (token | parameter) *( [";"] (token | parameter))

      token             = 1*<any CHAR except CTLs or separators>
      separators        = "(" | ")" | "<" | ">" | "@"
                        | "," | ";" | ":" | "\" | <">
                        | "/" | "[" | "]" | "?" | "="
                        | "{" | "}" | SP | HT

      quoted-string     = ( <"> *(qdtext | quoted-pair ) <"> )
      qdtext            = <any TEXT except <">>
      quoted-pair       = "\" CHAR

      parameter         = attribute "=" value
      attribute         = token
      value             = token | quoted-string

    Each header is represented by a list of key/value pairs.  The value for a
    simple token (not part of a parameter) is None.  Syntactically incorrect
    headers will not necessarily be parsed as you would want.

    This is easier to describe with some examples:

    >>> split_header_words(['foo="bar"; port="80,81"; discard, bar=baz'])
    [[('foo', 'bar'), ('port', '80,81'), ('discard', None)], [('bar', 'baz')]]
    >>> split_header_words(['text/html; charset="iso-8859-1"'])
    [[('text/html', None), ('charset', 'iso-8859-1')]]
    >>> split_header_words([r'Basic realm="\"foo\bar\""'])
    [[('Basic', None), ('realm', '"foobar"')]]

    rz\1N,z^[=\s;]*rVr	z&split_header_words bug: '%s', '%s', %s)
isinstancestrAssertionErrorHEADER_TOKEN_REr@rjrBHEADER_QUOTED_VALUE_REHEADER_ESCAPE_REr]HEADER_VALUE_RErstripappendr[
startswithresubn)
Z
header_valuesresultr_Z	orig_textpairsrEnamevalueZnon_junkZ
nr_junk_charsrrrsplit_header_wordsQsF-
	
	
r|z([\"\\])cCsg}x|D]}g}xk|D]c\}}|dk	rvtjd|sftjd|}d|}d||f}|j|q W|r
|jdj|q
Wdj|S)aDo the inverse (almost) of the conversion done by split_header_words.

    Takes a list of lists of (key, value) pairs and produces a single header
    value.  Attribute values are quoted if needed.

    >>> join_header_words([[("text/plain", None), ("charset", "iso-8859-1")]])
    'text/plain; charset="iso-8859-1"'
    >>> join_header_words([[("text/plain", None)], [("charset", "iso-8859-1")]])
    'text/plain, charset="iso-8859-1"'

    Nz^\w+$z\\\1z"%s"z%s=%sz; z, )rvr@HEADER_JOIN_ESCAPE_REr]rtjoin)Zlistsheadersryattrkvrrrjoin_header_wordss

rcCsB|jdr|dd}|jdr>|dd}|S)N"r)ruendswith)r_rrrstrip_quotess
rcCsnd}g}x[|D]S}g}d}xt|jd	D]\}}|j}|jd
\}}	}
|j}|s|dkr;Pnq;|	r|
jnd}
|dkr)|j}||kr|}|dkr|
dk	rt|
}
d
}n*|dkr)|
dk	r)tt|
}
|j||
fq;W|r|sY|jd|j|qW|S)a5Ad-hoc parser for Netscape protocol cookie-attributes.

    The old Netscape cookie format for Set-Cookie can for instance contain
    an unquoted "," in the expires field, so we have to use this ad-hoc
    parser instead of split_header_words.

    XXX This may not make the best possible effort to parse all the crap
    that Netscape Cookie headers contain.  Ronald Tschalar's HTTPClient
    parser is probably better, so could do worse than following that if
    this ever gives any trouble.

    Currently, this is also used for parsing RFC 2109 cookies.

    expiresdomainpathsecureversionportmax-ageF;=r	NT0)rrrrrrr)rr)	enumeratesplitstrip	partitionrKrrart)Z
ns_headersZknown_attrsrxZ	ns_headerryversion_setZiiZparamkeysepvallcrrrparse_ns_headerss@
"	
rz\.\d+$cCsKtj|rdS|dkr#dS|ddksC|ddkrGdSdS)z*Return True if text is a host domain name.FrVr	.rTr)IPV4_REr@)r_rrris_HDNs rcCs|j}|j}||kr(dSt|s8dS|j|}|dks_|dkrcdS|jdsvdSt|ddsdSdS)aReturn True if domain A domain-matches domain B, according to RFC 2965.

    A and B may be host domain names or IP addresses.

    RFC 2965, section 1:

    Host names can be specified either as an IP address or a HDN string.
    Sometimes we compare one host name with another.  (Such comparisons SHALL
    be case-insensitive.)  Host A's name domain-matches host B's if

         *  their host name strings string-compare equal; or

         * A is a HDN string and has the form NB, where N is a non-empty
            name string, B has the form .B', and B' is a HDN string.  (So,
            x.y.com domain-matches .Y.com but not Y.com.)

    Note that domain-match is not a commutative operation: a.b.c.com
    domain-matches .c.com, but not the reverse.

    TFrr	rNr)rKrrfindru)ABirrrdomain_matchsrcCstj|rdSdS)zdReturn True if text is a sort-of-like a host domain name.

    For accepting/blocking domains.

    FT)rr@)r_rrrliberal_is_HDNBsrcCs|j}|j}t|o-t|sD||kr@dSdS|jd}|rl|j|rldS|r||krdSdS)z\For blocking/accepting domains.

    A and B may be host domain names or IP addresses.

    TFr)rKrrur)rrinitial_dotrrruser_domain_matchLsrz:\d+$cCs_|j}tjj|d}|dkr@|jdd}tjd|d}|jS)zReturn request-host, as defined by RFC 2965.

    Variation from RFC: returned value is lowercased, for convenient
    comparison.

    rrVZHost)get_full_urlurllibparseZurlparseZ
get_headercut_port_rer]rK)requesturlhostrrrrequest_hostasrcCsIt|}}|jddkr?tj|r?|d}||fS)zzReturn a tuple (request-host, effective request-host name).

    As defined by RFC 2965, except both are lowercased.

    rrz.localr)rfindrr@)rerhnreq_hostrrreff_request_hostqs%
rcCsJ|j}tjj|}t|j}|jdsFd|}|S)z6Path component of request-URI, as defined by RFC 2965./)rrrZurlsplitescape_pathrru)rrpartsrrrrrequest_path|s
rcCsy|j}|jd}|dkro||dd}yt|Wqutk
rktd|dSYquXnt}|S)N:r	rznonnumeric port: '%s')rrrArLrDEFAULT_HTTP_PORT)rrrrrrrrequest_ports	

rz%/;:@&=+$,!~*'()z%([0-9a-fA-F][0-9a-fA-F])cCsd|jdjS)Nz%%%sr)rBrO)rgrrruppercase_escaped_charsrcCs+tjj|t}tjt|}|S)zEEscape any invalid characters in HTTP URL, and uppercase all escapes.)rrZquoteHTTP_PATH_SAFEESCAPED_CHAR_REr]r)rrrrrs
rcCsn|jd}|dkrj||dd}|jd}t|rj|dksb|dkrjd|S|S)aBReturn reach of host h, as defined by RFC 2965, section 1.

    The reach R of a host name H is defined as follows:

       *  If

          -  H is the host domain name of a host; and,

          -  H has the form A.B; and

          -  A has no embedded (that is, interior) dots; and

          -  B has at least one embedded dot, or B is the string "local".
             then the reach of H is .B.

       *  Otherwise, the reach of H is H.

    >>> reach("www.acme.com")
    '.acme.com'
    >>> reach("acme.com")
    'acme.com'
    >>> reach("acme.local")
    '.local'

    rr	rNZlocal)rr)hrbrrrreachs$rcCs0t|}t|t|js(dSdSdS)z

    RFC 2965, section 3.3.6:

        An unverifiable transaction is to a third-party host if its request-
        host U does not domain-match the reach R of the request-host O in the
        origin transaction.

    TFN)rrrZorigin_req_host)rrrrris_third_partys
rc@sseZdZdZdddZddZddd	Zd
dZddd
ZddZ	ddZ
dS)raHTTP Cookie.

    This class represents both Netscape and RFC 2965 cookies.

    This is deliberately a very simple class.  It just holds attributes.  It's
    possible to construct Cookie instances that don't comply with the cookie
    standards.  CookieJar.make_cookies is the factory function for Cookie
    objects -- it deals with cookie parsing, supplying defaults, and
    normalising to the representation used in this class.  CookiePolicy is
    responsible for checking them to see whether they should be accepted from
    and returned to the server.

    Note that the port may be present in the headers, but unspecified ("Port"
    rather than"Port=80", for example); if this is the case, port is None.

    FcCs|dk	rt|}|dk	r6tt|}|dkrZ|dkrZtd||_||_||_||_||_|j|_	||_
||_|	|_|
|_
||_||_|
|_||_||_||_tj||_dS)NTz-if port is None, port_specified must be false)rArZrLrrzr{rport_specifiedrKrdomain_specifieddomain_initial_dotrpath_specifiedrrdiscardcommentcomment_urlrfc2109copy_rest)selfrrzr{rrrrrrrrrrrrrestrrrr__init__s.
															zCookie.__init__cCs
||jkS)N)r)rrzrrrhas_nonstandard_attrszCookie.has_nonstandard_attrNcCs|jj||S)N)rget)rrzdefaultrrrget_nonstandard_attrszCookie.get_nonstandard_attrcCs||j|<dS)N)r)rrzr{rrrset_nonstandard_attrszCookie.set_nonstandard_attrcCs>|dkrtj}|jdk	r:|j|kr:dSdS)NTF)rMr)rnowrrr
is_expireds
zCookie.is_expiredcCsx|jdkrd}n
d|j}|j||j}|jdk	rad|j|jf}n	|j}d||fS)NrVrz%s=%sz<Cookie %s for %s>)rrrr{rz)rplimitZ	namevaluerrr__str__%s	
	zCookie.__str__cCsg}x:dD]2}t||}|jd|t|fq
W|jdt|j|jdt|jd|jjdj|fS)Nrrzr{rrrrrrrrrrrrz%s=%szrest=%sz
rfc2109=%sz%s(%s)z, )rrzr{rrrrrrrrrrrr)getattrrtreprrr	__class____name__r~)rrrzrrrr__repr__/s
!zCookie.__repr__)r
__module____qualname____doc__rrrrrrrrrrrrs 
c@sFeZdZdZddZddZddZdd	Zd
S)ra Defines which cookies get accepted from and returned to server.

    May also modify cookies, though this is probably a bad idea.

    The subclass DefaultCookiePolicy defines the standard rules for Netscape
    and RFC 2965 cookies -- override that if you want a customized policy.

    cCs
tdS)zReturn true if (and only if) cookie should be accepted from server.

        Currently, pre-expired cookies never get this far -- the CookieJar
        class deletes such cookies itself.

        N)NotImplementedError)rcookierrrrset_okGszCookiePolicy.set_okcCs
tdS)zAReturn true if (and only if) cookie should be returned to server.N)r)rrrrrr	return_okPszCookiePolicy.return_okcCsdS)zMReturn false if cookies should not be returned, given cookie domain.
        Tr)rrrrrrdomain_return_okTszCookiePolicy.domain_return_okcCsdS)zKReturn false if cookies should not be returned, given cookie path.
        Tr)rrrrrrpath_return_okYszCookiePolicy.path_return_okN)rrrrrrrrrrrrr>s
	c@speZdZdZdZdZdZdZeeBZdddddddddeddd	d
Z	ddZ
d
dZddZddZ
ddZddZddZddZddZddZdd Zd!d"Zd#d$Zd%d&Zd'd(Zd)d*Zd+d,Zd-d.Zd/d0Zd1d2Zd3d4Zd5d6ZdS)7rzBImplements the standard rules for accepting and returning cookies.rrrTr	NTFc

Cs||_||_||_||_||_||_|	|_|
|_||_||_	|dk	rxt
||_n	f|_|dk	rt
|}||_dS)zAConstructor arguments should be passed as keyword arguments only.N)
netscaperfc2965rfc2109_as_netscapehide_cookie2
strict_domainstrict_rfc2965_unverifiablestrict_ns_unverifiablestrict_ns_domainstrict_ns_set_initial_dollarstrict_ns_set_pathtuple_blocked_domains_allowed_domains)
rblocked_domainsallowed_domainsrrrrrrrrrrrrrris 
											zDefaultCookiePolicy.__init__cCs|jS)z4Return the sequence of blocked domains (as a tuple).)r)rrrrrsz#DefaultCookiePolicy.blocked_domainscCst||_dS)z$Set the sequence of blocked domains.N)rr)rrrrrset_blocked_domainssz'DefaultCookiePolicy.set_blocked_domainscCs+x$|jD]}t||r
dSq
WdS)NTF)rr)rrZblocked_domainrrr
is_blockedszDefaultCookiePolicy.is_blockedcCs|jS)z=Return None, or the sequence of allowed domains (as a tuple).)r)rrrrrsz#DefaultCookiePolicy.allowed_domainscCs%|dk	rt|}||_dS)z-Set the sequence of allowed domains, or None.N)rr)rrrrrset_allowed_domainssz'DefaultCookiePolicy.set_allowed_domainscCs>|jdkrdSx$|jD]}t||rdSqWdS)NFT)rr)rrZallowed_domainrrris_not_allowedsz"DefaultCookiePolicy.is_not_allowedcCsltd|j|j|jdk	s+tx:dD]2}d	|}t||}|||s2d
Sq2WdS)
z
        If you override .set_ok(), be sure to call this method.  If it returns
        false, so should your subclass (assuming your subclass wants to be more
        strict about which cookies to accept).

        z - checking cookie %s=%sNr
verifiabilityrzrrrZset_ok_FT)rrrzrrr)rrzr{rnr)rrrnfn_namefnrrrrs

zDefaultCookiePolicy.set_okcCs{|jdkr)td|j|jdS|jdkrP|jrPtddS|jdkrw|jrwtddSdS)Nz0   Set-Cookie2 without version attribute (%s=%s)Fr	z$   RFC 2965 cookies are switched offz$   Netscape cookies are switched offT)rrrzr{rr)rrrrrrset_ok_versions

z"DefaultCookiePolicy.set_ok_versioncCse|jrat|ra|jdkr;|jr;tddS|jdkra|jratddSdS)Nr	z>   third-party RFC 2965 cookie during unverifiable transactionFz>   third-party Netscape cookie during unverifiable transactionT)unverifiablerrrrr)rrrrrrset_ok_verifiabilitys

z(DefaultCookiePolicy.set_ok_verifiabilitycCsB|jdkr>|jr>|jjdr>td|jdSdS)Nr	$z'   illegal name (starts with '$'): '%s'FT)rrrzrur)rrrrrrset_ok_names
zDefaultCookiePolicy.set_ok_namecCsm|jrit|}|jdks<|jdkri|jri|j|j|ritd|j|dSdS)Nr	z7   path attribute %s is not a prefix of request path %sFT)rrrrrrr)rrrreq_pathrrrset_ok_paths	
zDefaultCookiePolicy.set_ok_pathc
Cs|j|jr&td|jdS|j|jrLtd|jdS|jrt|\}}|j}|jr|jddkr|jd}|jdd|}|dkr||dd}||d|}	|	j	d$krt
|dkrtd|dS|jdr=|dd}
n|}
|
jddk}|r||dkr|td|dS|j
dkr|j|r|jdrd|j|rtd ||dS|j
dks|j|j@rt||std!||dS|j
dks4|j|j@r|dt
|}|jddkrtj|rtd"||dSd#S)%Nz"   domain %s is in user block-listFz&   domain %s is not in user allow-listrrr	rcoaccomeduorgnetgovmilrAaerobizcatcoopinfojobsmobimuseumrzprotraveleuz&   country-code second level domain %sz.localz/   non-local domain %s contains no embedded dotzO   effective request-host %s (even with added initial dot) does not end with %sz5   effective request-host %s does not domain-match %sz.   host prefix %s for domain %s contains a dotT)rrrrrr	r
rrArr
rrrrrrrzrrr)rrrrrrrcountrrKlenrurrrrDomainRFC2965MatchrDomainStrictNoDotsrr@)
rrrrrrrjZtldZsldZundotted_domainZ
embedded_dotsZhost_prefixrrr
set_ok_domainsf			



z!DefaultCookiePolicy.set_ok_domaincCs|jrt|}|dkr*d}nt|}xr|jjdD]G}yt|Wn#tk
rtd|dSYnX||krIPqIWtd||jdSdS)N80rkz   bad port %s (not numeric)Fz$   request port (%s) not found in %sT)rrrmrrrArLr)rrrreq_portrrrrset_ok_port%s"		

	
zDefaultCookiePolicy.set_ok_portcCsWtd|j|jx:dD]2}d|}t||}|||sd	SqWd
S)z
        If you override .return_ok(), be sure to call this method.  If it
        returns false, so should your subclass (assuming your subclass wants to
        be more strict about which cookies to return).

        z - checking cookie %s=%srrrrrrZ
return_ok_FT)rrrrrr)rrzr{r)rrrrrrrrrr:s	

zDefaultCookiePolicy.return_okcCsR|jdkr'|jr'tddS|jdkrN|jrNtddSdS)Nr	z$   RFC 2965 cookies are switched offFz$   Netscape cookies are switched offT)rrrr)rrrrrrreturn_ok_versionLs

z%DefaultCookiePolicy.return_ok_versioncCse|jrat|ra|jdkr;|jr;tddS|jdkra|jratddSdS)Nr	z>   third-party RFC 2965 cookie during unverifiable transactionFz>   third-party Netscape cookie during unverifiable transactionT)rrrrrr)rrrrrrreturn_ok_verifiabilityUs

z+DefaultCookiePolicy.return_ok_verifiabilitycCs*|jr&|jdkr&tddSdS)NZhttpsz(   secure cookie with non-secure requestFT)rtyper)rrrrrrreturn_ok_secureas
z$DefaultCookiePolicy.return_ok_securecCs$|j|jr tddSdS)Nz   cookie expiredFT)r_nowr)rrrrrrreturn_ok_expiresgs
z%DefaultCookiePolicy.return_ok_expirescCsl|jrht|}|dkr'd}x>|jjdD]}||kr:Pq:Wtd||jdSdS)Nrrkz0   request port %s does not match cookie port %sFT)rrrr)rrrrrrrrreturn_ok_portms	
z"DefaultCookiePolicy.return_ok_portcCst|\}}|j}|r>|jdr>d|}n|}|jdkr|j|j@r|jr||krtddS|jdkrt||rtd||dS|jdkrd|j	|rtd||dSdS)Nrr	zQ   cookie with unspecified domain does not string-compare equal to request domainFzQ   effective request-host name %s does not domain-match RFC 2965 cookie domain %sz;   request-host %s does not match Netscape cookie domain %sT)
rrrurrDomainStrictNonDomainrrrr)rrrrrr	dotdomainrrrreturn_ok_domain{s&	


#
z$DefaultCookiePolicy.return_ok_domaincCst|\}}|jds+d|}|jdsDd|}|rg|jdrgd|}n|}|j|p|j|sdS|j|rtd|dS|j|rtd|dSdS)NrFz"   domain %s is in user block-listz&   domain %s is not in user allow-listT)rrurrrr)rrrrrr(rrrrs"




z$DefaultCookiePolicy.domain_return_okcCstd|t|}t|}||kr5dS|j|rq|jdsm|||ddkrqdStd||dS)Nz- checking cookie path=%sTrrz  %s does not path-match %sF)rrrrur)rrrrZpathlenrrrrs
)z"DefaultCookiePolicy.path_return_ok) rrrrrr'rZ
DomainLiberalZDomainStrictrrrrrrrrrrrrrrrr r!r#r%r&r)rrrrrrr_sL
	;	cCs"t|j}t|j|S)N)sortedkeysmapr)Zadictr+rrrvals_sorted_by_keysr-ccsgt|}xT|D]L}d}y|jWntk
r>YnXd}t|EdH|s|VqWdS)zBIterates over nested mapping, depth-first, in sorted order by key.FTN)r-itemsAttributeError
deepvalues)mappingvaluesobjrrrr0s

r0c@seZdZdS)AbsentN)rrrrrrrr4sr4c@s~eZdZdZejdZejdZejdZejdZ	ejdZ
ejdejZdd	d
Z
ddZd
dZddZddZddZddZddZddZddZddZdd Zd!d"Zd#d$Zdddd%d&Zd'd(Zd)d*Zd+d,Zd-d.Zd/d0Z d1d2Z!dS)3rzCollection of HTTP cookies.

    You may not need to know about this class: try
    urllib.request.build_opener(HTTPCookieProcessor).open(url).
    z\Wz([\"\\])z\.?[^.]*z[^.]*z^\.+z^\#LWP-Cookies-(\d+\.\d+)NcCs:|dkrt}||_tj|_i|_dS)N)r_policy
_threadingRLock
_cookies_lock_cookies)rpolicyrrrrs
		zCookieJar.__init__cCs
||_dS)N)r5)rr:rrr
set_policyszCookieJar.set_policycCsg}|jj||sgStd||j|}x|jD]x}|jj||sdqF||}xM|jD]?}|jj||stdq{td|j|q{WqFW|S)Nz!Checking %s for cookies to returnz   not returning cookiez   it's a match)	r5rrr9r+rr2rrt)rrrcookiesZcookies_by_pathrZcookies_by_namerrrr_cookies_for_domains 




zCookieJar._cookies_for_domaincCs=g}x0|jjD]}|j|j||qW|S)z2Return a list of cookies to be returned to server.)r9r+extendr=)rrr<rrrr_cookies_for_requestszCookieJar._cookies_for_requestc	Cs|jdddddd}g}x|D]}|j}|sgd}|dkrg|jd||jd	k	r|jj|jr|dkr|jjd
|j}n	|j}|jd	kr|j|jn|jd|j|f|dkr/|j	r |jd|j
|jjd
ru|j}|j
rd|jd
rd|dd	}|jd||jd	k	r/d}|jr|d|j}|j|q/W|S)zReturn a list of cookie-attributes to be returned to server.

        like ['foo="bar"; $Path="/"', ...]

        The $Version attribute is also added when appropriate (currently only
        once per request).

        rcSs
t|jS)N)rr)arrr<lambda>sz)CookieJar._cookie_attrs.<locals>.<lambda>reverseTFr	z$Version=%sNz\\\1z%s=%sz
$Path="%s"rrz$Domain="%s"z$Portz="%s")sortrrtr{non_word_rer@quote_rer]rzrrrrurrr)	rr<rattrsrrr{rrrrr
_cookie_attrss>

	!			
	zCookieJar._cookie_attrsc
Cstd|jjzttj|j_|_|j|}|j|}|r|j	ds|j
ddj||jjr|jj
r|j	drx.|D]&}|jdkr|j
ddPqWWd|jjX|jdS)zAdd correct Cookie: header to request (urllib.request.Request object).

        The Cookie2 header is also added unless policy.hide_cookie2 is true.

        add_cookie_headerrz; ZCookie2rz$Version="1"N)rr8acquirerArMr5r$r?rGZ
has_headerZadd_unredirected_headerr~rrrreleaseclear_expired_cookies)rrr<rFrrrrrHCs$


	zCookieJar.add_cookie_headercCsg}d}d}x|D]}|d\}}d}d}	i}
i}x|d
dD]}\}}
|j}||ks||kr|}||kr|
dkrd}
||
krqX|dkr|
dkrtdd}	P|
j}
|dkr|rqX|
dkrtdqX|dkryd}yt|
}
Wn#tk
retdd}	PYnXd}|j|
}
||ks||kr|
dkr|dkrtd|d}	P|
|
|<qX|
||<qXW|	rq|j|||
|fqW|S)aReturn list of tuples containing normalised cookie information.

        attrs_set is the list of lists of key,value pairs extracted from
        the Set-Cookie or Set-Cookie2 headers.

        Tuples are name, value, standard, rest, where name and value are the
        cookie name and value, standard is a dictionary containing the standard
        cookie-attributes (discard, secure, version, expires or max-age,
        domain, path and port) and rest is a dictionary containing the rest of
        the cookie-attributes.

        rrrrmax-agerrrr
commenturlr	FrNTz%   missing value for domain attributezM   missing or invalid value for expires attribute: treating as session cookiez?   missing or invalid (non-numeric) value for max-age attributez!   missing value for %s attribute)rr)rrrLrrrrrM)rrrM)rKrrArLr$rt)r	attrs_set
cookie_tuples
boolean_attrsvalue_attrsZcookie_attrsrzr{Zmax_age_setZ
bad_cookiestandardrrrrrrr_normalized_cookie_tuplesdsl








z#CookieJar._normalized_cookie_tuplesc!Cs|\}}}}|jdt}|jdt}|jdt}	|jdt}
|jdd}|dk	ryt|}Wntk
rdSYnX|jdd}|jdd}
|jd	d}|jd
d}|tk	r|dkrd}t|}nxd}t|}|jd
}|dkrv|dkrb|d|}n|d|d}t|dkrd
}|tk	}d}|rt|j	d}|tkrt
|\}}|}n|j	dsd|}d}|	tk	rF|	dkr(t|}	qLd}tj
dd|	}	nd}	|
tkrgd}
d}
nR|
|jkry|j|||Wntk
rYnXtd|||dSt||||	||||||||
|
|||S)NrrrrrrFrrrMrVTrrr	rz\s+z2Expiring cookie, domain='%s', path='%s', name='%s'r)rr4rArLrrrrboolrurrrvr]r$clearKeyErrorrr)rtuprrzr{rRrrrrrrrrrrrrrrrrrrrr_cookie_from_cookie_tuples
		
	

	z#CookieJar._cookie_from_cookie_tuplecCsO|j|}g}x3|D]+}|j||}|r|j|qW|S)N)rSrXrt)rrNrrOr<rWrrrr_cookies_from_attrs_set!s
z!CookieJar._cookies_from_attrs_setcCsjt|jdd}|dkr.|jj}x5|D]-}|jdkr5d|_|r5d|_q5WdS)NrrTr	)rr5rrr)rr<Z
rfc2109_as_nsrrrr_process_rfc2109_cookies*s

	z"CookieJar._process_rfc2109_cookiesc
Cs|j}|jdg}|jdg}|jj}|jj}|rV|s|rd|s|rr|s|r|rgSy|jt||}Wntk
rtg}YnX|r|ry|jt	||}	Wntk
rtg}	YnX|j
|	|rpi}
x*|D]"}d|
|j|j|j
f<q,W|
dd}t||	}	|	r|j|	|S)zAReturn sequence of Cookie objects extracted from response object.zSet-Cookie2z
Set-CookieNcSs"|j|j|jf}||kS)N)rrrz)Z	ns_cookielookuprrrrno_matching_rfc2965bsz3CookieJar.make_cookies.<locals>.no_matching_rfc2965)rZget_allr5rrrYr|	ExceptionrrrZrrrzfilterr>)
rresponserrZrfc2965_hdrsZns_hdrsrrr<Z
ns_cookiesr[rr\rrrmake_cookies6sB



 
zCookieJar.make_cookiesc
Csg|jjzEttj|j_|_|jj||rQ|j|Wd|jjXdS)z-Set a cookie if policy says it's OK to do so.N)	r8rIrArMr5r$r
set_cookierJ)rrrrrrset_cookie_if_okls
zCookieJar.set_cookie_if_okc
Cs|j}|jjzc|j|kr5i||j<||j}|j|kr^i||j<||j}|||j<Wd|jjXdS)z?Set a cookie, without checking whether or not it should be set.N)r9r8rIrrrzrJ)rrcZc2Zc3rrrrays	




zCookieJar.set_cookiec
Cstd|j|jjzottj|j_|_xI|j||D]5}|jj	||rUtd||j
|qUWWd|jjXdS)zAExtract cookies from response, where allowable given the request.zextract_cookies: %sz setting cookie: %sN)rrr8rIrArMr5r$r`rrarJ)rr_rrrrrextract_cookiess

zCookieJar.extract_cookiescCs|dk	rE|dks$|dkr0td|j|||=nW|dk	rz|dkritd|j||=n"|dk	r|j|=n	i|_dS)aClear some cookies.

        Invoking this method without arguments will clear all cookies.  If
        given a single argument, only cookies belonging to that domain will be
        removed.  If given two arguments, cookies belonging to the specified
        path within that domain are removed.  If given three arguments, then
        the cookie with the specified name, path and domain is removed.

        Raises KeyError if no matching cookie exists.

        Nz8domain and path must be given to remove a cookie by namez.domain must be given to remove cookies by path)rLr9)rrrrzrrrrUs		
zCookieJar.clearcCs\|jjz:x3|D]+}|jr|j|j|j|jqWWd|jjXdS)zDiscard all session cookies.

        Note that the .save() method won't save session cookies anyway, unless
        you ask otherwise by passing a true ignore_discard argument.

        N)r8rIrrUrrrzrJ)rrrrrclear_session_cookiess

	$zCookieJar.clear_session_cookiescCsn|jjzLtj}x9|D]1}|j|r#|j|j|j|jq#WWd|jjXdS)aDiscard all expired cookies.

        You probably don't need to call this method: expired cookies are never
        sent back to the server (provided you're using DefaultCookiePolicy),
        this method is called by CookieJar itself every so often, and the
        .save() method won't save expired cookies anyway (unless you ask
        otherwise by passing a true ignore_expires argument).

        N)	r8rIrMrrUrrrzrJ)rrrrrrrKs


$zCookieJar.clear_expired_cookiescCs
t|jS)N)r0r9)rrrr__iter__szCookieJar.__iter__cCs%d}x|D]}|d}q
W|S)z#Return number of contained cookies.r	rr)rrrrrr__len__s
zCookieJar.__len__cCsGg}x!|D]}|jt|q
Wd|jjdj|fS)Nz<%s[%s]>z, )rtrrrr~)rrrrrrrs
zCookieJar.__repr__cCsGg}x!|D]}|jt|q
Wd|jjdj|fS)Nz<%s[%s]>z, )rtrmrrr~)rrhrrrrrs
zCookieJar.__str__)"rrrrrvcompilerDrEZstrict_domain_reZ	domain_reZdots_reASCIImagic_rerr;r=r?rGrHrSrXrYrZr`rbrardrUrerKrfrgrrrrrrrs8;!a\	6

c@seZdZdS)rN)rrrrrrrrsc@sjeZdZdZdddddZdddddZddddd	Zdddd
dZdS)rz6CookieJar that can be loaded from and saved to a file.NFc	Cs[tj|||dk	r?y|dWntdYnX||_t||_dS)z}
        Cookies are NOT loaded from the named file until either the .load() or
        .revert() method is called.

        NrVzfilename must be string-like)rrrLfilenamerT	delayload)rrlrmr:rrrrs	zFileCookieJar.__init__cCs
tdS)zSave cookies to a file.N)r)rrlignore_discardignore_expiresrrrsaveszFileCookieJar.savecCsc|dkr3|jdk	r'|j}nttt|}|j||||WdQRXdS)zLoad cookies from a file.N)rlrLMISSING_FILENAME_TEXTopen_really_load)rrlrnrorrrrloadszFileCookieJar.loadcCs|dkr3|jdk	r'|j}ntt|jjzWtj|j}i|_y|j|||Wnt	k
r||_YnXWd|jj
XdS)zClear all cookies and reload cookies from a saved file.

        Raises LoadError (or OSError) if reversion is not successful; the
        object's state will not be altered if this happens.

        N)rlrLrqr8rIrdeepcopyr9rtOSErrorrJ)rrlrnroZ	old_staterrrreverts
	
	zFileCookieJar.revert)rrrrrrprtrwrrrrrs	cCs|j|jfd|jfd|jfg}|jdk	rR|jd|jf|jrh|jd|jr~|jd|jr|jd|j	r|jd|j
r|jd	tt|j
f|j
r|jd|jr
|jd|jf|jr)|jd|jft|jj}x.|D]&}|j|t|j|fqEW|jd
t|jft|gS)zReturn string representation of Cookie in the LWP cookie file format.

    Actually, the format is extended a bit -- see module docstring.

    rrNr	path_spec	port_spec
domain_dotrrrrrMr)rxN)ryN)rzN)rN)rN)rzr{rrrrtrrrrrr5rZrrrr*rr+rmrr)rrr+rrrrlwp_cookie_str"s6	
	
	
	
			
		
$r{c@sIeZdZdZddddZdddddZd	d
ZdS)ra[
    The LWPCookieJar saves a sequence of "Set-Cookie3" lines.
    "Set-Cookie3" is the format used by the libwww-perl library, not known
    to be compatible with any browser, but which is easy to read and
    doesn't lose information about RFC 2965 cookies.

    Additional methods

    as_lwp_str(ignore_discard=True, ignore_expired=True)

    TcCsztj}g}xQ|D]I}|r2|jr2q|rK|j|rKq|jdt|qWdj|dgS)zReturn cookies as a string of "\n"-separated "Set-Cookie3" headers.

        ignore_discard and ignore_expires: see docstring for FileCookieJar.save

        zSet-Cookie3: %s
rV)rMrrrtr{r~)rrnrorrhrrrr
as_lwp_strKs
zLWPCookieJar.as_lwp_strNFcCsv|dkr3|jdk	r'|j}nttt|d-}|jd|j|j||WdQRXdS)Nwz#LWP-Cookies-2.0
)rlrLrqrrwriter})rrlrnrorrrrrp[s
zLWPCookieJar.savecCs|j}|jj|s4d|}t|tj}d}d}	d}
y_xX|j}|dkrqP|j|sqX|t|dj}x
t|gD]}|d\}
}i}i}x|	D]}d||<qWx|ddD]\}}|dk	r$|j	}nd}||
ksB||	krH|}||	krs|dkrfd}|||<q||
kr|||<q|||<qW|j
}|d}|d}|dk	rt|}|dkrd}|d}|jd}t|d|
||d	|d|||d|d
|d|d|||d
|d|}|r|j
rq|r|j|rq|j|qWqXWWnCtk
rYn/tk
rttd||fYnXdS)Nz5%r does not look like a Set-Cookie3 (LWP) format filezSet-Cookie3:ryrxrzrrrrrrrrrMrVr	FrTrz&invalid Set-Cookie3 format file %r: %r)ryrxrzrr)rrrrrrrM)readlinerkr@rrMrurrr|rKrrdrrrrarvr]r)rrrlrnromagicrrheaderrPrQlinedatarzr{rRrrrrrrrrrrcrrrrsgs


					

zLWPCookieJar._really_load)rrrrr}rprsrrrrr>sc@sLeZdZdZejdZdZddZddddd	Z	dS)
ra

    WARNING: you may want to backup your browser's cookies file if you use
    this class to save cookies.  I *think* it works, but there have been
    bugs in the past!

    This class differs from CookieJar only in the format it uses to save and
    load cookies to and from a file.  This class uses the Mozilla/Netscape
    `cookies.txt' format.  lynx uses this file format, too.

    Don't expect cookies saved while the browser is running to be noticed by
    the browser (in fact, Mozilla on unix will overwrite your saved cookies if
    you change them on disk while it's running; on Windows, you probably can't
    save at all while the browser is running).

    Note that the Mozilla/Netscape format will downgrade RFC2965 cookies to
    Netscape cookies on saving.

    In particular, the cookie version and port number information is lost,
    together with information about whether or not Path, Port and Discard were
    specified by the Set-Cookie2 (or Set-Cookie) header, and whether or not the
    domain as set in the HTTP header started with a dot (yes, I'm aware some
    domains in Netscape files start with a dot and some don't -- trust me, you
    really don't want to know any more about this).

    Note that though Mozilla and Netscape use the same format, they use
    slightly different headers.  The class saves cookies using the Netscape
    header by default (Mozilla can cope with that).

    z#( Netscape)? HTTP Cookie Filezr# Netscape HTTP Cookie File
# http://curl.haxx.se/rfc/cookie_spec.html
# This is a generated file!  Do not edit.

cCstj}|j}|jj|s:td|yrxk|j}|dkrYP|jdrx|dd}|jjds@|jdkrq@|jd\}}	}
}}}
}|dk}|	dk}	|
dkr|}
d}|jd	}|	|kst	d
}|dkr5d}d}t
d|
|dd
||	||
d
|||ddi}|r|jrq@|r|j|rq@|j
|q@WWnCtk
rYn/tk
rttd
||fYnXdS)Nz4%r does not look like a Netscape format cookies filerVr|r#r	TRUErFTr	z+invalid Netscape format cookies file %r: %rr)rr)rMrrkr@rrrrurrnrrrrarvr]r)rrrlrnrorrrrrrrrrzr{rrrcrrrrssb
$		

zMozillaCookieJar._really_loadNFcCsq|dkr3|jdk	r'|j}nttt|d(}|j|jtj}x|D]}|r|jrqh|r|j|rqh|j	rd}nd}|j
jdrd}nd}|jdk	rt
|j}	nd}	|jdkrd}
|j}n|j}
|j}|jdj|j
||j||	|
|gdqhWWdQRXdS)Nr~rZFALSErrVrr|)rlrLrqrrrrrMrrrrrurrmr{rzr~r)rrlrnrorrrrrrrzr{rrrrps<
					zMozillaCookieJar.save)
rrrrrvrirkrrsrprrrrrs
A)Yr__all__rr-rvrMZurllib.parserZurllib.requestZ	threadingr6ImportErrorZdummy_threadingZhttp.clientZhttpZcalendarr
rrrrmZclientZ	HTTP_PORTrrqrr%r,r6r7rIr(rtrKr5r8r>rirjr?rFrSrXIr\Xr^rarbrdrjrorprrrqr|r}rrrrrrrrrrrrrrrrrrrrrrr-r0r4rrvrrr{rrrrrr<module>s


88!UD'

#b!_:x
Back to Directory File Manager