`WnH @ s7 d d l m Z d d l m Z d d l Z d d l Z d d l m Z d d l m Z
d d l m Z d d l
m Z m Z m Z m Z d d l m Z m Z m Z d d
l m Z d d l m Z m Z d d l m Z m Z Gd
d d e Z! Gd d d e Z" d d Z# Gd d d e j$ Z% d S) )absolute_import)contextmanagerN)timeout)error )HTTPHeaderDict)
ProtocolError DecodeErrorReadTimeoutErrorResponseNotChunked) string_types binary_typePY3) http_client)
HTTPException BaseSSLError) is_fp_closedis_response_to_headc @ s4 e Z d Z d d Z d d Z d d Z d S)DeflateDecoderc C s( d | _ t | _ t j | _ d S)NT)
_first_tryr
_datazlib
decompressobj_obj)self r /response.py__init__ s zDeflateDecoder.__init__c C s t | j | S)N)getattrr )r namer r r __getattr__ s zDeflateDecoder.__getattr__c C s | s
| S| j s# | j j | S| j | 7_ y | j j | SWnU t j k
r d | _ t j t j | _ z | j | j SWd d | _ XYn Xd S)NF)r r
decompressr r r r MAX_WBITS)r datar r r r! s zDeflateDecoder.decompressN)__name__
__module__ __qualname__r r r! r r r r r s r c @ s4 e Z d Z d d Z d d Z d d Z d S) GzipDecoderc C s t j d t j | _ d S)N )r r r" r )r r r r r 1 s zGzipDecoder.__init__c C s t | j | S)N)r r )r r r r r r 4 s zGzipDecoder.__getattr__c C s | s
| S| j j | S)N)r r! )r r# r r r r! 7 s zGzipDecoder.decompressN)r$ r% r& r r r! r r r r r' / s r' c C s | d k r t St S)Ngzip)r' r )moder r r _get_decoder= s r+ c
@ s e Z d Z d Z d d g Z d d d d d g Z d d
d d d
d d d d
d
d
d
d Z d d Z d d Z e d d Z
d d Z d d Z d d Z
d d Z e d d Z d
d
d d d! Z d> d
d$ d% Z e d& d' Z d( d) Z d
d* d+ Z d, d- Z e d. d/ Z d0 d1 Z d2 d3 Z d4 d5 Z d6 d7 Z d8 d9 Z d: d; Z d
d
d< d= Z d
S)? HTTPResponsea
HTTP Response container.
Backwards-compatible to httplib's HTTPResponse but the response ``body`` is
loaded and decoded on-demand when the ``data`` property is accessed. This
class is also compatible with the Python standard library's :mod:`io`
module, and can hence be treated as a readable object in the context of that
framework.
Extra parameters for behaviour not present in httplib.HTTPResponse:
:param preload_content:
If True, the response's body will be preloaded during construction.
:param decode_content:
If True, attempts to decode specific content-encoding's based on headers
(like 'gzip' and 'deflate') will be skipped and raw data will be used
instead.
:param original_response:
When this HTTPResponse wrapper is generated from an httplib.HTTPResponse
object, it's convenient to include the original for debug purposes. It's
otherwise unused.
r) Zdeflatei- i. i/ i3 i4 Nr Tc C sY t | t r | | _ n t | | _ | | _ | | _ | | _ | | _ | | _ d | _ d | _ d | _
| | _ d | _ | r t | t
t f r | | _ |
| _ | | _ t | d r | | _
d | _ d | _ | j j d d j } d d | j d D }
d |
k r0d
| _ | rU| j rU| j d | | _ d S) Nr readFztransfer-encodingr- c s s | ] } | j Vq d S)N)strip).0encr r r <genexpr> s z(HTTPResponse.__init__.<locals>.<genexpr>,chunkedTdecode_content)
isinstancer headersstatusversionreasonstrictr5 _decoder_body_fp_original_response_fp_bytes_read
basestringr
_pool _connectionhasattrr4
chunk_leftgetlowersplitr. )r bodyr7 r8 r9 r: r; Zpreload_contentr5 original_responsepool
connectionZtr_enc encodingsr r r r a s6 zHTTPResponse.__init__c C s& | j | j k r" | j j d Sd S)a
Should we redirect and where to?
:returns: Truthy redirect location string if we got a redirect status
code and valid location. ``None`` if redirect status and no
location. ``False`` if not a redirect status code.
locationF)r8 REDIRECT_STATUSESr7 rF )r r r r get_redirect_location s z"HTTPResponse.get_redirect_locationc C s8 | j s | j r d S| j j | j d | _ d S)N)rB rC Z _put_conn)r r r r release_conn s zHTTPResponse.release_connc C s- | j r | j S| j r) | j d d Sd S)N
cache_contentT)r= r> r. )r r r r r# s zHTTPResponse.datac C s | j S)z
Obtain the number of bytes pulled over the wire so far. May differ from
the amount of content returned by :meth:``HTTPResponse.read`` if bytes
are encoded on the wire (e.g, compressed).
)r@ )r r r r tell s zHTTPResponse.tellc C sL | j j d d j } | j d k rH | | j k rH t | | _ d S)z<
Set-up the _decoder attribute if necessar.
zcontent-encodingr- N)r7 rF rG r< CONTENT_DECODERSr+ )r content_encodingr r r
_init_decoder s zHTTPResponse._init_decoderc C s y% | r$ | j r$ | j j | } Wn\ t t j f k
r } z3 | j j d d j } t d | | WYd d } ~ Xn X| r | r | | j 7} | S)zN
Decode the data passed in and potentially flush the decoder.
zcontent-encodingr- zEReceived response with content-encoding: %s, but failed to decode it.N)
r< r! IOErrorr r r7 rF rG r _flush_decoder)r r# r5
flush_decodererU r r r _decode s zHTTPResponse._decodec C s0 | j r, | j j d } | | j j Sd S)zk
Flushes the decoder. Should only be called if the decoder is actually
being used.
)r< r! flush)r bufr r r rX s zHTTPResponse._flush_decoderc c s* d } z y d VWn t k
r; t | j d d Yn t k
r } z/ d t | k rb t | j d d WYd d } ~ Xn> t t f k
r } z t d | | WYd d } ~ Xn Xd } Wd | s| j r | j j | j
r| j
j | j r%| j j r%| j Xd S)z
Catch low-level python exceptions, instead re-raising urllib3
variants, so that low-level exceptions are not leaked in the
high-level api.
On exit, release the connection back to the pool.
FNzRead timed out.zread operation timed outzConnection broken: %rT)
SocketTimeoutr
rB r strr SocketErrorr r? closerC isclosedrQ )r Z
clean_exitrZ r r r _error_catcher s(
'&
zHTTPResponse._error_catcherFc C s | j | d k r | j } | j d k r2 d Sd } d } | j g | d k ro | j j } d } n> d } | j j | } | d k r | r | j j d } Wd QRX| r | j t | 7_ | j | | | } | r | | _ | S)aP
Similar to :meth:`httplib.HTTPResponse.read`, but with two additional
parameters: ``decode_content`` and ``cache_content``.
:param amt:
How much of the content to read. If specified, caching is skipped
because it doesn't make sense to cache partial content as the full
response.
:param decode_content:
If True, will attempt to decode the body based on the
'content-encoding' header.
:param cache_content:
If True, will save the returned data such that the same result is
returned despite of the state of the underlying file object. This
is useful if you want the ``.data`` property to continue working
after having ``.read()`` the file object. (Overridden if ``amt`` is
set.)
NFTr )
rV r5 r> rd r. rb r@ lenr[ r= )r amtr5 rR rY r# r r r r. s,
zHTTPResponse.read r( c c sn | j r1 x^ | j | d | D] } | Vq Wn9 x6 t | j si | j d | d | } | r4 | Vq4 Wd S)a_
A generator wrapper for the read() method. A call will block until
``amt`` bytes have been read from the connection or until the
connection is closed.
:param amt:
How much of the content to read. The generator will return up to
much data per iteration, but may return less. This is particularly
likely when using compressed data. However, the empty string will
never be returned.
:param decode_content:
If True, will attempt to decode the body based on the
'content-encoding' header.
r5 rf N)r4 read_chunkedr r> r. )r rf r5 liner# r r r streamL s zHTTPResponse.streamc K s | j } t | t sB t r3 t | j } n t j | } t | d d } | d | d | d | j d | j d | j d | d | | } | S) a
Given an :class:`httplib.HTTPResponse` instance ``r``, return a
corresponding :class:`urllib3.response.HTTPResponse` object.
Remaining parameters are passed to the HTTPResponse constructor, along
with ``original_response=r``.
r; r rI r7 r8 r9 r: rJ )
msgr6 r r items from_httplibr r8 r9 r: )Z ResponseClsrZ response_kwr7 r; Zrespr r r rm f s zHTTPResponse.from_httplibc C s | j S)N)r7 )r r r r
getheaders s zHTTPResponse.getheadersc C s | j j | | S)N)r7 rF )r r defaultr r r getheader s zHTTPResponse.getheaderc C s0 | j s | j j | j r, | j j d S)N)closedr> rb rC )r r r r rb s
zHTTPResponse.closec C sV | j d k r d St | j d r/ | j j St | j d rN | j j Sd Sd S)NTrr rc )r> rD rr rc )r r r r rr s
zHTTPResponse.closedc C sM | j d k r t d n+ t | j d r= | j j St d d S)Nz-HTTPResponse has no file to get a fileno fromfilenozOThe file-like object this HTTPResponse is wrapped around has no file descriptor)r> rW rD rs )r r r r rs s
zHTTPResponse.filenoc C s2 | j d k r. t | j d r. | j j Sd S)Nr] )r> rD r] )r r r r r] s !zHTTPResponse.flushc C s d S)NTr )r r r r readable s zHTTPResponse.readablec C sO | j t | } t | d k r+ d S| | d t | <t | Sd S)Nr )r. re )r bZtempr r r readinto s
zHTTPResponse.readintoc C s | j d k r d S| j j j } | j d d d } y t | d | _ Wn+ t k
r~ | j t j | Yn Xd S)N ;r r r( )
rE r> fpreadlinerH int
ValueErrorrb httplibZIncompleteRead)r ri r r r _update_chunk_length s
z!HTTPResponse._update_chunk_lengthc C s d } | d k rI | j j | j } | } | j j d d | _ n | | j k r | j j | } | j | | _ | } nq | | j k r | j j | } | j j d d | _ | } n. | j j | j } | j j d d | _ | S)Nrg )r> Z
_safe_readrE )r rf Zreturned_chunkchunkvaluer r r
_handle_chunk s& zHTTPResponse._handle_chunkc
c s | j | j s t d | j rH t | j rH | j j d S| j xS | j | j d k rr P| j | } | j
| d | d d } | rX | VqX W| r | j } | r | Vx* | j j
j } | s P| d k r Pq W| j r | j j Wd QRXd S)z
Similar to :meth:`HTTPResponse.read`, but with an additional
parameter: ``decode_content``.
:param decode_content:
If True, will attempt to decode the body based on the
'content-encoding' header.
zHResponse is not chunked. Header 'transfer-encoding: chunked' is missing.Nr r5 rY Fs
)rV r4 r r? r rb rd r} rE r r[ rX r> rx ry )r rf r5 r~ Zdecodedri r r r rh s:
zHTTPResponse.read_chunkedi ) r$ r% r& __doc__rT rO r rP rQ propertyr# rS rV r[ rX r rd r. rj classmethodrm ro rq rb rr rs r] rt rv r} r rh r r r r r, D s8 (
9< r, )&Z
__future__r
contextlibr r iosocketr r_ r ra _collectionsr
exceptionsr r r
r Z packages.sixr rA r
r Zpackages.six.movesr r| rL r r Z
util.responser r objectr r' r+ IOBaser, r r r r <module> s "