V% @ sI d d l m Z d d l Z y d d l m Z Wn" e k
rT d d l m Z Yn Xd d l m Z d d l m
Z
m Z d d l m Z d d l
m Z m Z m Z d d l m Z d d
l m Z d d l m Z d d
d g Z e j e Z d Z d e
d e i Z Gd d d e Z Gd d
d
e Z d d Z d S) )absolute_importN)urljoin )RecentlyUsedContainer)HTTPConnectionPoolHTTPSConnectionPool)port_by_scheme)LocationValueError
MaxRetryErrorProxySchemeUnknown)RequestMethods) parse_url)Retry PoolManager ProxyManagerproxy_from_urlkey_file cert_file cert_reqsca_certs ssl_version ca_cert_dirhttphttpsc @ s e Z d Z d Z d Z d d d d Z d d Z d d Z d
d Z d d
Z d d d d Z
d d Z d d d Z d S)r a$
Allows for arbitrary requests while transparently keeping track of
necessary connection pools for you.
:param num_pools:
Number of connection pools to cache before discarding the least
recently used pool.
:param headers:
Headers to include with all requests, unless other headers are given
explicitly.
:param \**connection_pool_kw:
Additional parameters are used to create fresh
:class:`urllib3.connectionpool.ConnectionPool` instances.
Example::
>>> manager = PoolManager(num_pools=2)
>>> r = manager.request('GET', 'http://google.com/')
>>> r = manager.request('GET', 'http://google.com/mail')
>>> r = manager.request('GET', 'http://yahoo.com/')
>>> len(manager.pools)
2
N
c K sA t j | | | | _ t | d d d | _ t | _ d S)NZ dispose_funcc S s
| j S)N)close)p r /poolmanager.py<lambda>B s z&PoolManager.__init__.<locals>.<lambda>)r __init__connection_pool_kwr poolspool_classes_by_scheme)self num_poolsheadersr! r r r r > s
zPoolManager.__init__c C s | S)Nr )r$ r r r __enter__G s zPoolManager.__enter__c C s | j d S)NF)clear)r$ exc_typeexc_valexc_tbr r r __exit__J s
zPoolManager.__exit__c C sb | j | } | j } | d k rR | j j } x t D] } | j | d q8 W| | | | S)a
Create a new :class:`ConnectionPool` based on host, port and scheme.
This method is used to actually create the connection pools handed out
by :meth:`connection_from_url` and companion methods. It is intended
to be overridden for customization.
r N)r# r! copy SSL_KEYWORDSpop)r$ schemehostportZpool_clskwargskwr r r _new_poolO s
zPoolManager._new_poolc C s | j j d S)z
Empty our store of pools and direct them all to close.
This will not affect in-flight connections, but they will not be
re-used after completion.
N)r" r( )r$ r r r r( ` s zPoolManager.clearr c C s | s t d | p d } | p3 t j | d } | | | f } | j j C | j j | } | rn | S| j | | | } | | j | <Wd QRX| S)z
Get a :class:`ConnectionPool` based on the host, port, and scheme.
If ``port`` isn't given, it will be derived from the ``scheme`` using
``urllib3.connectionpool.port_by_scheme``.
zNo host specified.r P N)r r getr" lockr5 )r$ r1 r2 r0 Zpool_keypoolr r r connection_from_hosti s
z PoolManager.connection_from_hostc C s. t | } | j | j d | j d | j S)a*
Similar to :func:`urllib3.connectionpool.connection_from_url` but
doesn't pass any additional parameters to the
:class:`urllib3.connectionpool.ConnectionPool` constructor.
Additional parameters are taken from the :class:`.PoolManager`
constructor.
r2 r0 )r
r: r1 r2 r0 )r$ urlur r r connection_from_url s z PoolManager.connection_from_urlTc
K s t | } | j | j d | j d | j } d | d <d | d <d | k r] | j | d <| j d k r | j d k r | j | | | } n | j | | j | } | o | j } | s | St
| | } | j d k r d
} | j d } t
| t s t j | d | } y" | j | | d | d
| } Wn" t k
rd| j r\ | SYn X| | d <| | d <t j d | | | j | | | S)a]
Same as :meth:`urllib3.connectionpool.HTTPConnectionPool.urlopen`
with custom cross-host redirect logic and only sends the request-uri
portion of the ``url``.
The given ``url`` parameter must be absolute, such that an appropriate
:class:`urllib3.connectionpool.ConnectionPool` can be chosen for it.
r2 r0 FZassert_same_hostredirectr& Nr i/ GETretriesresponseZ_poolzRedirecting %s -> %s)r
r: r1 r2 r0 r& proxyurlopenZ request_uriZget_redirect_locationr statusr7
isinstancer Zfrom_intZ incrementr
Zraise_on_redirectloginfo)
r$ methodr; r> r4 r< connrA Zredirect_locationr@ r r r rC s8 $
"
zPoolManager.urlopen)
__name__
__module__ __qualname____doc__rB r r' r, r5 r( r: r= rC r r r r r s c sm e Z d Z d Z d d d f d d Z d d f d d Z d d d
Z d f d d
Z S)r aw
Behaves just like :class:`PoolManager`, but sends all requests through
the defined proxy, using the CONNECT method for HTTPS URLs.
:param proxy_url:
The URL of the proxy to be used.
:param proxy_headers:
A dictionary contaning headers that will be sent to the proxy. In case
of HTTP they are being sent with each request, while in the
HTTPS/CONNECT case they are sent only once. Could be used for proxy
authentication.
Example:
>>> proxy = urllib3.ProxyManager('http://localhost:3128/')
>>> r1 = proxy.request('GET', 'http://google.com/')
>>> r2 = proxy.request('GET', 'http://httpbin.org/')
>>> len(proxy.pools)
1
>>> r3 = proxy.request('GET', 'https://httpbin.org/')
>>> r4 = proxy.request('GET', 'https://twitter.com/')
>>> len(proxy.pools)
3
r Nc s t | t r+ d | j | j | j f } t | } | j sg t j | j d } | j d | } | j d k r t | j | | _
| p i | _ | j
| d <| j | d <t t
| j | | | d S) Nz
%s://%s:%ir6 r2 r r _proxyZ_proxy_headers)zhttpr )rE r r0 r1 r2 r
r r7 _replacer rB
proxy_headerssuperr r )r$ proxy_urlr% r& rP r! rB r2 ) __class__r r r s
zProxyManager.__init__r c sV | d k r( t t | j | | | St t | j | j j | j j | j j S)Nr )rQ r r: rB r1 r2 r0 )r$ r1 r2 r0 )rS r r r: s
z!ProxyManager.connection_from_hostc C sB d d i } t | j } | r+ | | d <| r> | j | | S)z
Sets headers needed by proxies: specifically, the Accept and Host
headers. Only sets headers not provided by the user.
ZAcceptz*/*ZHost)r
netlocupdate)r$ r; r& Zheaders_rT r r r _set_proxy_headers s
z ProxyManager._set_proxy_headersTc sh t | } | j d k rF | j d | j } | j | | | d <t t | j | | d | | S)z@Same as HTTP(S)ConnectionPool.urlopen, ``url`` must be absolute.r r& r> )r
r0 r7 r& rV rQ r rC )r$ rH r; r> r4 r< r& )rS r r rC
s
zProxyManager.urlopen)rJ rK rL rM r r: rV rC r r )rS r r s c K s t d | | S)NrR )r )r; r4 r r r r s )r r r r r r ) Z
__future__r loggingZ urllib.parser ImportErrorurlparse _collectionsr Zconnectionpoolr r r
exceptionsr r
r Zrequestr Zutil.urlr
Z
util.retryr __all__ getLoggerrJ rF r. r# r r r r r r r <module> s*
W