Viewing File: /usr/lib/python2.7/site-packages/requests/utils.pyo


YЅ_c@sdZddlZddlZddlZddlZddlZddlZddlZddlZddl	Z	ddl
Z
ddlZddlm
Z
ddlmZddlmZddlmZmZmZmZmZmZmZmZmZmZmZmZddlmZm Z dd	l!m"Z"dd
l#m$Z$efZ%d8Z&ej'Z(id
d6dd6Z)dZ*dZ+dZ,dZ-dZ.dZ/dZ0dZ1e2dZ3dZ4dZ5dZ6dZ7dZ8dZ9d Z:e;d!d"Z<d#Z=d$Z>d%Z?d&Z@d'ZAd(ZBd)ZCd*ZDd+d,ZEd-ZFd.ZGd/jHd0ZIeId1ZJeId2ZKd3ZLd4ZMd5ZNd0d6ZOd7ZPdS(9s
requests.utils
~~~~~~~~~~~~~~

This module provides utility functions that are used within Requests
that are also useful for external consumption.

iNi(t__version__(tcerts(tparse_http_list(tquoteturlparsetbyteststrtOrderedDicttunquotetis_py2tbuiltin_strt
getproxiestproxy_bypasst
urlunparset
basestring(tRequestsCookieJartcookiejar_from_dict(tCaseInsensitiveDict(t
InvalidURLs.netrct_netrciPthttpithttpscCs"t|dr|j}n|S(s/Returns an internal sequence dictionary update.titems(thasattrR(td((s2/usr/lib/python2.7/site-packages/requests/utils.pytdict_to_sequence+scCst|drt|St|dr/|jSt|drxy|j}Wntjk
rdqxXtj|jSnt|drt|jSdS(Nt__len__tlentfilenotgetvalue(	RRRtiotUnsupportedOperationtostfstattst_sizeR(toR((s2/usr/lib/python2.7/site-packages/requests/utils.pyt	super_len4s
c
Cs2yddlm}m}d}x^tD]V}ytjjdj|}Wntk
r_dSXtjj	|r&|}Pq&q&W|dkrdSt
|}|jjdd}yG||j
|}|r|drdnd}	||	|dfSWn|tfk
rnXWnttfk
r-nXdS(	s;Returns the Requests tuple auth for a given url from netrc.i(tnetrctNetrcParseErrors~/{0}Nt:iii(R%R&tNonetNETRC_FILESR tpatht
expandusertformattKeyErrortexistsRtnetloctsplittauthenticatorstIOErrortImportErrortAttributeError(
turlR%R&t
netrc_pathtftloctrithostRtlogin_i((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_netrc_authHs0

cCs[t|dd}|rWt|trW|ddkrW|ddkrWtjj|SdS(s0Tries to guess the filename of the given object.tnameit<it>N(tgetattrR(t
isinstanceRR R*tbasename(tobjR=((s2/usr/lib/python2.7/site-packages/requests/utils.pytguess_filenamevs%cCsD|dkrdSt|ttttfr:tdnt|S(sTake an object and test to see if it can be represented as a
    dictionary. Unless it can not be represented as such, return an
    OrderedDict, e.g.,

    ::

        >>> from_key_val_list([('key', 'val')])
        OrderedDict([('key', 'val')])
        >>> from_key_val_list('string')
        ValueError: need more than 1 value to unpack
        >>> from_key_val_list({'key': 'val'})
        OrderedDict([('key', 'val')])
    s+cannot encode objects that are not 2-tuplesN(R(RARRtbooltintt
ValueErrorR(tvalue((s2/usr/lib/python2.7/site-packages/requests/utils.pytfrom_key_val_list~s
cCse|dkrdSt|ttttfr:tdnt|tjr[|j	}nt
|S(szTake an object and test to see if it can be represented as a
    dictionary. If it can be, return a list of tuples, e.g.,

    ::

        >>> to_key_val_list([('key', 'val')])
        [('key', 'val')]
        >>> to_key_val_list({'key': 'val'})
        [('key', 'val')]
        >>> to_key_val_list('string')
        ValueError: cannot encode objects that are not 2-tuples.
    s+cannot encode objects that are not 2-tuplesN(R(RARRRERFRGtcollectionstMappingRtlist(RH((s2/usr/lib/python2.7/site-packages/requests/utils.pytto_key_val_lists
cCshg}x[t|D]M}|d |dko8dknrSt|dd!}n|j|qW|S(sParse lists as described by RFC 2068 Section 2.

    In particular, parse comma-separated lists where the elements of
    the list may include quoted-strings.  A quoted-string could
    contain a comma.  A non-quoted string could have quotes in the
    middle.  Quotes are removed automatically after parsing.

    It basically works like :func:`parse_set_header` just that items
    may appear multiple times and case sensitivity is preserved.

    The return value is a standard :class:`list`:

    >>> parse_list_header('token, "quoted value"')
    ['token', 'quoted value']

    To create a header from the :class:`list` again, use the
    :func:`dump_header` function.

    :param value: a string with a list header.
    :return: :class:`list`
    iit"(t_parse_list_headertunquote_header_valuetappend(RHtresulttitem((s2/usr/lib/python2.7/site-packages/requests/utils.pytparse_list_headers$cCsi}xt|D]~}d|kr5d||<qn|jdd\}}|d |dkoldknrt|dd!}n|||<qW|S(sMParse lists of key, value pairs as described by RFC 2068 Section 2 and
    convert them into a python dict:

    >>> d = parse_dict_header('foo="is a fish", bar="as well"')
    >>> type(d) is dict
    True
    >>> sorted(d.items())
    [('bar', 'as well'), ('foo', 'is a fish')]

    If there is no value for a key it will be `None`:

    >>> parse_dict_header('key_without_value')
    {'key_without_value': None}

    To create a header from the :class:`dict` again, use the
    :func:`dump_header` function.

    :param value: a string with a dict header.
    :return: :class:`dict`
    t=iiRNN(ROR(R0RP(RHRRRSR=((s2/usr/lib/python2.7/site-packages/requests/utils.pytparse_dict_headers
$cCsq|rm|d|dko%dknrm|dd!}|sN|d dkrm|jddjddSn|S(	sUnquotes a header value.  (Reversal of :func:`quote_header_value`).
    This does not use the real unquoting but what browsers are actually
    using for quoting.

    :param value: the header value to unquote.
    iiRNiis\\s\s\"(treplace(RHtis_filename((s2/usr/lib/python2.7/site-packages/requests/utils.pyRPs
*
cCs+i}x|D]}|j||j<q
W|S(soReturns a key/value dictionary from a CookieJar.

    :param cj: CookieJar object to extract cookies from.
    (RHR=(tcjtcookie_dicttcookie((s2/usr/lib/python2.7/site-packages/requests/utils.pytdict_from_cookiejars
cCst|}|j||S(sReturns a CookieJar from a key/value dictionary.

    :param cj: CookieJar to insert cookies into.
    :param cookie_dict: Dict of key/values to insert into CookieJar.
    (Rtupdate(RYRZtcj2((s2/usr/lib/python2.7/site-packages/requests/utils.pytadd_dict_to_cookiejars
cCsvtjdttjddtj}tjddtj}tjd}|j||j||j|S(slReturns encodings from given content string.

    :param content: bytestring to extract encodings from.
    sIn requests 3.0, get_encodings_from_content will be removed. For more information, please see the discussion on issue #2266. (This warning should only appear once.)s!<meta.*?charset=["\']*(.+?)["\'>]tflagss+<meta.*?content=["\']*;?charset=(.+?)["\'>]s$^<\?xml.*?encoding=["\']*(.+?)["\'>](twarningstwarntDeprecationWarningtretcompiletItfindall(tcontentt
charset_ret	pragma_retxml_re((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_encodings_from_content"scCs_|jd}|sdStj|\}}d|krK|djdSd|kr[dSdS(smReturns encodings from given HTTP Header Dict.

    :param headers: dictionary to extract encoding from.
    scontent-typetcharsets'"ttexts
ISO-8859-1N(tgetR(tcgitparse_headertstrip(theaderstcontent_typetparams((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_encoding_from_headers6sccs|jdkr)x|D]}|VqWdStj|jdd}x+|D]#}|j|}|rK|VqKqKW|jddt}|r|VndS(sStream decodes a iterator.NterrorsRWttfinal(tencodingR(tcodecstgetincrementaldecodertdecodetTrue(titeratortrRStdecodertchunktrv((s2/usr/lib/python2.7/site-packages/requests/utils.pytstream_decode_response_unicodeJs
	
ccs=d}x0|t|kr8||||!V||7}q	WdS(s Iterate over slices of a string.iN(R(tstringtslice_lengthtpos((s2/usr/lib/python2.7/site-packages/requests/utils.pytiter_slices\scCstjdtg}t|j}|rcyt|j|SWqctk
r_|j|qcXnyt|j|ddSWnt	k
r|jSXdS(sReturns the requested content back in unicode.

    :param r: Response object to get unicode content from.

    Tried:

    1. charset from content-type
    2. fall back and replace all unicode characters

    sIn requests 3.0, get_unicode_from_response will be removed. For more information, please see the discussion on issue #2266. (This warning should only appear once.)RwRWN(
RaRbRcRvRsRRhtUnicodeErrorRQt	TypeError(Rttried_encodingsRz((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_unicode_from_responseds

t4ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyzs0123456789-._~cCs|jd}xtdt|D]}||dd!}t|dkr|jrytt|d}Wn!tk
rtd|nX|tkr|||d||<qd||||<q%d||||<q%Wdj	|S(sUn-escape any percent-escape sequences in a URI that are unreserved
    characters. This leaves all reserved, illegal and non-ASCII bytes encoded.
    t%iiiis%Invalid percent-escape sequence: '%s'Rx(
R0trangeRtisalnumtchrRFRGRtUNRESERVED_SETtjoin(turitpartstithtc((s2/usr/lib/python2.7/site-packages/requests/utils.pytunquote_unreserveds
cCsKd}d}ytt|d|SWntk
rFt|d|SXdS(sRe-quote the given URI.

    This function passes the given URI through an unquote/quote cycle to
    ensure that it is fully and consistently quoted.
    s!#$%&'()*+,/:;=?@[]~s!#$&'()*+,/:;=?@[]~tsafeN(RRR(Rtsafe_with_percenttsafe_without_percent((s2/usr/lib/python2.7/site-packages/requests/utils.pytrequote_uris
cCstjdtj|d}|jd\}}tjdtjtt|d}tjdtj|d|@}||@||@kS(s
    This function allows you to check if on IP belongs to a network subnet
    Example: returns True if ip = 192.168.1.1 and net = 192.168.1.0/24
             returns False if ip = 192.168.1.1 and net = 192.168.100.0/24
    s=Lit/(tstructtunpacktsockett	inet_atonR0tdotted_netmaskRF(tiptnettipaddrtnetaddrtbitstnetmasktnetwork((s2/usr/lib/python2.7/site-packages/requests/utils.pytaddress_in_networks
+#cCs/ddd|>dA}tjtjd|S(st
    Converts mask from /xx format to xxx.xxx.xxx.xxx
    Example: if mask is 24 function returns 255.255.255.0
    lii s>I(Rt	inet_ntoaRtpack(tmaskR((s2/usr/lib/python2.7/site-packages/requests/utils.pyRscCs-ytj|Wntjk
r(tSXtS(N(RRterrortFalseR~(t	string_ip((s2/usr/lib/python2.7/site-packages/requests/utils.pytis_ipv4_addresss
cCs|jddkryt|jdd}Wntk
rFtSX|dks_|dkrctSytj|jddWqtjk
rtSXntStS(s9Very simple check of the cidr format in no_proxy variableRii i(	tcountRFR0RGRRRRR~(tstring_networkR((s2/usr/lib/python2.7/site-packages/requests/utils.pyt
is_valid_cidrs
cCsd}|d}t|j}|r|jddjd}|jdd}t|rxs|D](}t|rkt||rtSqkqkWqx@|D]5}|j|s|jddj|rtSqWnyt	|}Wn t
tjfk
rt
}nX|rtSt
S(s:
    Returns whether we should bypass proxies or not.
    cSs(tjj|p'tjj|jS(N(R tenvironRotupper(tk((s2/usr/lib/python2.7/site-packages/requests/utils.pyt<lambda>stno_proxyt Rxt,R'i(RR/RWR0RRRR~tendswithRRRtgaierrorR(R5t	get_proxyRR/Rtproxy_ipR:tbypass((s2/usr/lib/python2.7/site-packages/requests/utils.pytshould_bypass_proxiess*	

+
cCst|riStSdS(s%Return a dict of environment proxies.N(RR(R5((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_environ_proxiessspython-requestscCs7tj}|dkr'tj}n|dkrdtjjtjjtjjf}tjjdkrdj	|tjjg}qn<|dkrtj}n!|dkrtj}nd}ytj
}tj}Wntk
rd}d}nXd	j	d
|t
fd
||fd
||fgS(s4Return a string representing the default user agent.tCPythontPyPys%s.%s.%sRyRxtJythont
IronPythontUnknownRs%s/%s(tplatformtpython_implementationtpython_versiontsystpypy_version_infotmajortminortmicrotreleaselevelRtsystemtreleaseR2R(R=t_implementationt_implementation_versiontp_systemt	p_release((s2/usr/lib/python2.7/site-packages/requests/utils.pytdefault_user_agents.	!


cCs2titd6djd
d6dd6dd	6S(Ns
User-Agents, tgziptdeflatesAccept-Encodings*/*tAccepts
keep-alivet
Connection(RR(RRR(((s2/usr/lib/python2.7/site-packages/requests/utils.pytdefault_headers=s

c	Csg}d}xtjd|D]}y|jdd\}}Wntk
ra|d}}nXi}|jd|d<xa|jdD]P}y|jd\}}Wntk
rPnX|j|||j|<qW|j|qW|S(	sReturn a dict of parsed link headers proxies.

    i.e. Link: <http:/.../front.jpeg>; rel=front; type="image/jpeg",<http://.../back.jpeg>; rel=back;type="image/jpeg"

    s '"s, *<t;iRxs<> '"R5RU(RdR0RGRrRQ(	RHtlinkst
replace_charstvalR5Rutlinktparamtkey((s2/usr/lib/python2.7/site-packages/requests/utils.pytparse_header_linksFs"

 ttasciiiicCs|d }|tjtjfkr&dS|d tjkr=dS|d tjtjfkr]dS|jt}|dkr|dS|dkr|dddtkrd	S|d
ddtkrdSn|dkr|d t	krdS|d
t	krd
SndS(Nisutf-32is	utf-8-sigisutf-16isutf-8s	utf-16-beis	utf-16-les	utf-32-bes	utf-32-le(R{tBOM_UTF32_LEtBOM32_BEtBOM_UTF8tBOM_UTF16_LEtBOM_UTF16_BERt_nullt_null2t_null3R((tdatatsamplet	nullcount((s2/usr/lib/python2.7/site-packages/requests/utils.pytguess_json_utfns*
cCsSt||\}}}}}}|s7||}}nt||||||fS(sGiven a URL that may or may not have a scheme, prepend the given scheme.
    Does not replace a present scheme with the one provided as an argument.(RR
(R5t
new_schemetschemeR/R*Rutquerytfragment((s2/usr/lib/python2.7/site-packages/requests/utils.pytprepend_scheme_if_neededs!cCsRt|}y"t|jt|jf}Wnttfk
rMd}nX|S(s_Given a url with authentication components, extract them into a tuple of
    username,password.Rx(RxRx(RRtusernametpasswordR4R(R5tparsedtauth((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_auth_from_urls"
cCsId}t|tr|}n'tr6|j|}n|j|}|S(s
    Given a string object, regardless of type, returns a representation of that
    string in the native string type, encoding and decoding where necessary.
    This assumes ASCII unless told otherwise.
    N(R(RAR
R	tencodeR}(RRztout((s2/usr/lib/python2.7/site-packages/requests/utils.pytto_native_strings	cCsft|\}}}}}}|s4||}}n|jddd}t|||||dfS(sE
    Given a url remove the fragment and the authentication part
    t@iiRx(RtrsplitR
(R5RR/R*RuRR((s2/usr/lib/python2.7/site-packages/requests/utils.pyt
urldefragauths
(s.netrcs_netrc(Qt__doc__RpR{RJRR RRdRRRRaRxRRtcompatRRORRRRRRR	R
RRR
RtcookiesRRt
structuresRt
exceptionsRt_hush_pyflakesR)twheretDEFAULT_CA_BUNDLE_PATHt
DEFAULT_PORTSRR$R<RDRIRMRTRVRRPR\R_RlRvRRRt	frozensetRRRRRRRRRRRRRRRRRRRRR(((s2/usr/lib/python2.7/site-packages/requests/utils.pyt<module>
sxR					.					"							$
			
					-				#

			

Back to Directory File Manager