ó
í!gc @ s d d l Z d d l Z d d l Z y d d l m Z Wn! e k
r[ d d l m Z n Xd d l m Z d d l m
Z
m Z d d l m Z d d l
m Z m Z d d l m Z d d l m Z d d
l m Z d d d
g Z e j e ƒ Z d% Z e j d d& ƒ Z e j d e j d' ƒ Z e j d e j e ƒ Z d „ Z i e j! e e ƒ d 6e j! e e ƒ d! 6Z" i e
d 6e d! 6Z# d e f d" „ ƒ YZ$ d e$ f d# „ ƒ YZ% d$ „ Z& d S(( iÿÿÿÿN( t urljoini ( t RecentlyUsedContainer( t HTTPConnectionPoolt HTTPSConnectionPool( t port_by_scheme( t LocationValueErrort
MaxRetryError( t RequestMethods( t parse_url( t Retryt PoolManagert ProxyManagert proxy_from_urlt key_filet cert_filet cert_reqst ca_certst ssl_versiont ca_cert_dirt BasePoolKeyt schemet hostt portt HTTPPoolKeyt timeoutt retriest strictt blockt source_addresst HTTPSPoolKeyc C s_ i } x$ | j D] } | j | ƒ | | <q W| d j ƒ | d <| d j ƒ | d <| | S( s¦
Create a pool key of type ``key_class`` for a request.
According to RFC 3986, both the scheme and host are case-insensitive.
Therefore, this function normalizes both before constructing the pool
key for an HTTPS request. If you wish to change this behaviour, provide
alternate callables to ``key_fn_by_scheme``.
:param key_class:
The class to use when constructing the key. This should be a namedtuple
with the ``scheme`` and ``host`` keys at a minimum.
:param request_context:
A dictionary-like object that contain the context for a request.
It should contain a key for each field in the :class:`HTTPPoolKey`
R R ( t _fieldst gett lower( t key_classt request_contextt contextt key( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt _default_key_normalizer. s t httpt httpsc B s} e Z d Z d
Z d d
d „ Z d „ Z d „ Z d „ Z d „ Z d
d d „ Z
d „ Z d
„ Z d „ Z
e d „ Z RS( s$
Allows for arbitrary requests while transparently keeping track of
necessary connection pools for you.
:param num_pools:
Number of connection pools to cache before discarding the least
recently used pool.
:param headers:
Headers to include with all requests, unless other headers are given
explicitly.
:param \**connection_pool_kw:
Additional parameters are used to create fresh
:class:`urllib3.connectionpool.ConnectionPool` instances.
Example::
>>> manager = PoolManager(num_pools=2)
>>> r = manager.request('GET', 'http://google.com/')
>>> r = manager.request('GET', 'http://google.com/mail')
>>> r = manager.request('GET', 'http://yahoo.com/')
>>> len(manager.pools)
2
i
c K sM t j | | ƒ | | _ t | d d „ ƒ| _ t | _ t j ƒ | _ d S( Nt dispose_funcc S s
| j ƒ S( N( t close( t p( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt <lambda>x s ( R t __init__t connection_pool_kwR t poolst pool_classes_by_schemet key_fn_by_schemet copy( t selft num_poolst headersR- ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyR, t s c C s | S( N( ( R2 ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt __enter__ s c C s | j ƒ t S( N( t cleart False( R2 t exc_typet exc_valt exc_tb( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt __exit__‚ s
c C sb t | } | j } | d k rR | j j ƒ } x! t D] } | j | d ƒ q5 Wn | | | | S( s
Create a new :class:`ConnectionPool` based on host, port and scheme.
This method is used to actually create the connection pools handed out
by :meth:`connection_from_url` and companion methods. It is intended
to be overridden for customization.
R& N( R/ R- R1 t SSL_KEYWORDSt popt None( R2 R R R t pool_clst kwargst kw( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt _new_pool‡ s
c C s | j j ƒ d S( s´
Empty our store of pools and direct them all to close.
This will not affect in-flight connections, but they will not be
re-used after completion.
N( R. R6 ( R2 ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyR6 ˜ s R& c C sz | s t d ƒ ‚ n | j j ƒ } | p- d | d <| sY t j | d j ƒ d ƒ } n | | d <| | d <| j | ƒ S( sÖ
Get a :class:`ConnectionPool` based on the host, port, and scheme.
If ``port`` isn't given, it will be derived from the ``scheme`` using
``urllib3.connectionpool.port_by_scheme``.
s No host specified.R& R iP R R ( R R- R1 R R R t connection_from_context( R2 R R R R" ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt connection_from_host¡ s
c C s6 | d j ƒ } | j | } | | ƒ } | j | ƒ S( sâ
Get a :class:`ConnectionPool` based on the request context.
``request_context`` must at least contain the ``scheme`` key and its
value must be a key in ``key_fn_by_scheme`` instance variable.
R ( R R0 t connection_from_pool_key( R2 R" R t pool_key_constructort pool_key( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyRC µ s
c C s^ | j j L | j j | ƒ } | r) | S| j | j | j | j ƒ } | | j | <Wd QX| S( sû
Get a :class:`ConnectionPool` based on the provided pool key.
``pool_key`` should be a namedtuple that only contains immutable
objects. At a minimum it must have the ``scheme``, ``host``, and
``port`` fields.
N( R. t lockR RB R R R ( R2 RG t pool( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyRE Â s
c C s. t | ƒ } | j | j d | j d | j ƒS( s*
Similar to :func:`urllib3.connectionpool.connection_from_url` but
doesn't pass any additional parameters to the
:class:`urllib3.connectionpool.ConnectionPool` constructor.
Additional parameters are taken from the :class:`.PoolManager`
constructor.
R R ( R RD R R R ( R2 t urlt u( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt connection_from_url× s c
K sõ t | ƒ } | j | j d | j d | j ƒ} t | d <t | d <d | k rf | j j ƒ | d <n | j d
k rœ | j d k rœ | j
| | | } n | j
| | j | } | oà | j ƒ } | sÐ | St
| | ƒ } | j d k r÷ d } n | j d ƒ } t | t ƒ s-t j | d | ƒ} n | j rq| j | ƒ rqx( | j D] }
| d j |
d
ƒ qPWn y" | j | | d
| d | ƒ} Wn! t k
r¶| j r²‚ n | SX| | d <| | d <t j d | | f ƒ | j
| | | S( s]
Same as :meth:`urllib3.connectionpool.HTTPConnectionPool.urlopen`
with custom cross-host redirect logic and only sends the request-uri
portion of the ``url``.
The given ``url`` parameter must be absolute, such that an appropriate
:class:`urllib3.connectionpool.ConnectionPool` can be chosen for it.
R R t assert_same_hostt redirectR4 R& i/ t GETR t responset _pools Redirecting %s -> %sN( R RD R R R R7 R4 R1 t proxyR> t urlopent request_urit get_redirect_locationR t statusR t
isinstanceR t from_intt remove_headers_on_redirectt is_same_hostR= t incrementR t raise_on_redirectt logt info( R2 t methodRJ RN RA RK t connRP t redirect_locationR t header( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyRS ã s@ $
"
N( t __name__t
__module__t __doc__R> RR R, R5 R; RB R6 RD RC RE RL t TrueRS ( ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyR
V s
c B sG e Z d Z d d d d „ Z d d d „ Z d d „ Z e d „ Z RS( sw
Behaves just like :class:`PoolManager`, but sends all requests through
the defined proxy, using the CONNECT method for HTTPS URLs.
:param proxy_url:
The URL of the proxy to be used.
:param proxy_headers:
A dictionary contaning headers that will be sent to the proxy. In case
of HTTP they are being sent with each request, while in the
HTTPS/CONNECT case they are sent only once. Could be used for proxy
authentication.
Example:
>>> proxy = urllib3.ProxyManager('http://localhost:3128/')
>>> r1 = proxy.request('GET', 'http://google.com/')
>>> r2 = proxy.request('GET', 'http://httpbin.org/')
>>> len(proxy.pools)
1
>>> r3 = proxy.request('GET', 'https://httpbin.org/')
>>> r4 = proxy.request('GET', 'https://twitter.com/')
>>> len(proxy.pools)
3
i
c K s¿ t | t ƒ r. d | j | j | j f } n t | ƒ } | j sm t j | j d ƒ } | j d | ƒ } n | | _ | p i | _
| j | d <| j
| d <t t | ƒ j
| | | d S( Ns
%s://%s:%iiP R t _proxyt _proxy_headers( RW R R R R R R R t _replaceRR t
proxy_headerst superR R, ( R2 t proxy_urlR3 R4 Rj R- RR R ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyR, : s
R& c C sV | d k r( t t | ƒ j | | | ƒ St t | ƒ j | j j | j j | j j ƒ S( NR' ( Rk R RD RR R R R ( R2 R R R ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyRD Q s
c C sI i d d 6} t | ƒ j } | r/ | | d <n | rE | j | ƒ n | S( s
Sets headers needed by proxies: specifically, the Accept and Host
headers. Only sets headers not provided by the user.
s */*t Acceptt Host( R t netloct update( R2 RJ R4 t headers_Ro ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt _set_proxy_headersY s
c K sk t | ƒ } | j d k rI | j d | j ƒ } | j | | ƒ | d <n t t | ƒ j | | d | | S( s@ Same as HTTP(S)ConnectionPool.urlopen, ``url`` must be absolute.R& R4 RN ( R R R R4 Rr Rk R RS ( R2 R_ RJ RN RA RK R4 ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyRS h s
N( Rc Rd Re R> R, RD Rr Rf RS ( ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyR s c K s t d | | S( NRl ( R ( RJ RA ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyR v s ( R
R R R R R ( s schemes hosts port( R s retriess stricts blockR (' t collectionst functoolst loggingt urllib.parseR t ImportErrort urlparset _collectionsR t connectionpoolR R R t
exceptionsR R t requestR t util.urlR t
util.retryR t __all__t getLoggerRc R] R< t
namedtupleR R R R R% t partialR0 R/ R
R R ( ( ( s7 /usr/lib/python2.7/site-packages/urllib3/poolmanager.pyt <module> sB
ÉW