3 �Pfp�@s�dZddlZddlZddlZddlmZddlmZddlm Z ddl mZmZm Z mZmZddlmZmZmZmZdd lmZmZmZdd lmZmZddlmZddlmZm Z dd l!m"Z"m#Z#m$Z$m%Z%ddl&m'Z'ddl(m)Z)ddlm*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0ddl1m2Z2ddlm3Z3ej4�dk�rXy ej5Z6Wne7k �rTej8Z6YnXnejZ6e fdd�Z9e fdd�Z:Gdd�de;�ZdS)z� requests.session ~~~~~~~~~~~~~~~~ This module provides a Session object to manage and persist settings across requests (cookies, auth, proxies). �N)�Mapping)� timedelta�)�_basic_auth_str)� cookielib�is_py3�OrderedDict�urljoin�urlparse)�cookiejar_from_dict�extract_cookies_to_jar�RequestsCookieJar� merge_cookies)�Request�PreparedRequest�DEFAULT_REDIRECT_LIMIT)� default_hooks� dispatch_hook)�to_native_string)�to_key_val_list�default_headers)�TooManyRedirects� InvalidSchema�ChunkedEncodingError�ContentDecodingError)�CaseInsensitiveDict)�HTTPAdapter)�requote_uri�get_environ_proxies�get_netrc_auth�should_bypass_proxies�get_auth_from_url�rewind_body� DEFAULT_PORTS)�codes)�REDIRECT_STATIZWindowscCst|dkr|S|dkr|St|t�o*t|t�s0|S|t|��}|jt|��dd�|j�D�}x|D] }||=qbW|S)z�Determines appropriate setting for a given request, taking into account the explicit setting on that request, and the setting in the session. If a setting is a dictionary, they will be merged together using `dict_class` NcSsg|]\}}|dkr|�qS)N�)�.0�k�vr&r&�/usr/lib/python3.6/sessions.py� Jsz!merge_setting..)� isinstancerr�update�items)Zrequest_settingZsession_setting� dict_classZmerged_settingZ none_keys�keyr&r&r*� merge_setting2s r1cCs@|dks|jd�gkr|S|dks0|jd�gkr4|St|||�S)z�Properly merges both requests and session hooks. This is necessary because when request_hooks == {'response': []}, the merge breaks Session hooks entirely. N�response)�getr1)Z request_hooksZ session_hooksr/r&r&r*�merge_hooksQs r4c@s>eZdZdd�Zdd�Zddd �Zd d�Zdd �Zdd�ZdS)�SessionRedirectMixincCs,|jr(|jd}tr|jd�}t|d�SdS)z7Receives a Response. Returns a redirect URI or ``None``�location�latin1�utf8N)Zis_redirect�headersr�encoder)�self�respr6r&r&r*�get_redirect_targetbs z(SessionRedirectMixin.get_redirect_targetcCs�t|�}t|�}|j|jkr dS|jdkrL|jdkrL|jdkrL|jd krLdS|j|jk}|j|jk}tj|jd�df}|r�|j|kr�|j|kr�dS|p�|S) zFDecide whether Authorization header should be removed when redirectingTZhttp�PNZhttps�F)r>N)r?N)r Zhostname�schemeZportr#r3)r;Zold_urlZnew_urlZ old_parsedZ new_parsedZchanged_portZchanged_schemeZdefault_portr&r&r*�should_strip_authxs z&SessionRedirectMixin.should_strip_authFNTc ks.g} |j|�}�x|�r(|j�}| j|�| dd�|_y |jWn(tttfk rj|jj dd�YnXt |j�|jkr�td|j|d��|j �|jd�r�t|j�} dt| j�|f}t|�}|j�}|js�t|jt|��}nt|�}t|�|_|j||�|jtjtjfk�r>d}x|D]}|jj|d��q Wd|_|j}y |d=Wntk �rdYnXt |j!||j�t"|j!|j#�|j$|j!�|j%||�}|j&||�|j'dk �o�d |k�p�d|k}|�r�t(|�|}|�r�|Vq|j)|f|||||dd �| ��}t |j#||j�|j|�}|VqWdS)zBReceives a Response. Returns a generator of Responses or Requests.rNF)Zdecode_contentzExceeded %s redirects.)r2z//z%s:%s�Content-Length�Content-Type�Transfer-EncodingZCookie)�stream�timeout�verify�cert�proxies�allow_redirects)rBrCrD)*r=�copy�append�history�contentrr�RuntimeError�raw�read�len� max_redirectsr�close� startswithr �urlrr@ZgeturlZnetlocr r�rebuild_method�status_coder$Ztemporary_redirectZpermanent_redirectr9�popZbody�KeyErrorrZ_cookiesr�cookiesZprepare_cookies�rebuild_proxies�rebuild_authZ_body_positionr"�send)r;r<�reqrErFrGrHrI�yield_requestsZadapter_kwargsZhistrV�prepared_requestZparsed_rurlZparsedZpurged_headers�headerr9Z rewindabler&r&r*�resolve_redirects�sr z&SessionRedirectMixin.resolve_redirectscCsR|j}|j}d|kr*|j|jj|�r*|d=|jr8t|�nd}|dk rN|j|�dS)z�When being redirected we may want to strip authentication from the request to avoid leaking credentials. This method intelligently removes and reapplies authentication where possible to avoid credential loss. Z AuthorizationN)r9rVrA�request� trust_envrZprepare_auth)r;rar2r9rVZnew_authr&r&r*r]�s z!SessionRedirectMixin.rebuild_authc Cs�|dk r|ni}|j}|j}t|�j}|j�}|jd�}t||d�}|jr~|r~t||d�} | j|| jd��} | r~|j || �d|kr�|d=yt ||�\}}Wntk r�d\}}YnX|r�|r�t||�|d<|S)a�This method re-evaluates the proxy configuration by considering the environment variables. If we are redirected to a URL covered by NO_PROXY, we strip the proxy configuration. Otherwise, we set missing proxy keys for this URL (in case they were stripped by a previous redirect). This method also replaces the Proxy-Authorization header where necessary. :rtype: dict N�no_proxy)rf�allzProxy-Authorization)NN) r9rVr r@rKr3r rer� setdefaultr!rZr) r;rarIr9rVr@Znew_proxiesrfZbypass_proxyZenviron_proxies�proxyZusernameZpasswordr&r&r*r\s* z$SessionRedirectMixin.rebuild_proxiescCsX|j}|jtjkr|dkrd}|jtjkr6|dkr6d}|jtjkrN|dkrNd}||_dS)z�When being redirected we may want to change the method of the request based on certain specs or browser behavior. �HEAD�GET�POSTN)�methodrXr$Z see_other�foundZmoved)r;rar2rmr&r&r*rW:sz#SessionRedirectMixin.rebuild_method)FNTNNF) �__name__� __module__�__qualname__r=rArcr]r\rWr&r&r&r*r5`s k)r5c@s�eZdZdZdddddddd d ddd dg Zdd�Zdd�Zdd�Zdd�Zd7dd�Z dd�Z dd�Zdd �Zd8d!d"�Z d9d#d$�Zd:d%d&�Zd'd(�Zd)d*�Zd+d,�Zd-d.�Zd/d0�Zd1d2�Zd3d4�Zd5d6�ZdS);�Sessiona~A Requests session. Provides cookie persistence, connection-pooling, and configuration. Basic Usage:: >>> import requests >>> s = requests.Session() >>> s.get('http://httpbin.org/get') Or as a context manager:: >>> with requests.Session() as s: >>> s.get('http://httpbin.org/get') r9r[�authrI�hooks�paramsrGrHZprefetch�adaptersrErerScCsrt�|_d|_i|_t�|_i|_d|_d|_d|_ t |_d|_t i�|_t�|_|jdt��|jdt��dS)NFTzhttps://zhttp://)rr9rsrIrrtrurErGrHrrSrerr[rrv�mountr)r;r&r&r*�__init__js zSession.__init__cCs|S)Nr&)r;r&r&r*� __enter__�szSession.__enter__cGs|j�dS)N)rT)r;�argsr&r&r*�__exit__�szSession.__exit__c Cs�|jpi}t|tj�st|�}ttt�|j�|�}|j}|jrV|rV|jrVt |j �}t�}|j|j j�|j |j|j|jt|j|jtd�t|j|j�t||j�|t|j|j�d� |S)a�Constructs a :class:`PreparedRequest ` for transmission and returns it. The :class:`PreparedRequest` has settings merged from the :class:`Request ` instance and those of the :class:`Session`. :param request: :class:`Request` instance to prepare with this session's settings. :rtype: requests.PreparedRequest )r/) rmrV�files�data�jsonr9rursr[rt)r[r,rZ CookieJarrrr rsrerrVrZpreparerm�upperr|r}r~r1r9rrur4rt)r;rdr[Zmerged_cookiesrs�pr&r&r*�prepare_request�s* zSession.prepare_requestNTcCstt|j�||||pi||pi|||d� }|j|�}|p8i}|j|j|| ||�}| | d�}|j|�|j|f|�}|S)a�Constructs a :class:`Request `, prepares it and sends it. Returns :class:`Response ` object. :param method: method for the new :class:`Request` object. :param url: URL for the new :class:`Request` object. :param params: (optional) Dictionary or bytes to be sent in the query string for the :class:`Request`. :param data: (optional) Dictionary, bytes, or file-like object to send in the body of the :class:`Request`. :param json: (optional) json to send in the body of the :class:`Request`. :param headers: (optional) Dictionary of HTTP Headers to send with the :class:`Request`. :param cookies: (optional) Dict or CookieJar object to send with the :class:`Request`. :param files: (optional) Dictionary of ``'filename': file-like-objects`` for multipart encoding upload. :param auth: (optional) Auth tuple or callable to enable Basic/Digest/Custom HTTP Auth. :param timeout: (optional) How long to wait for the server to send data before giving up, as a float, or a :ref:`(connect timeout, read timeout) ` tuple. :type timeout: float or tuple :param allow_redirects: (optional) Set to True by default. :type allow_redirects: bool :param proxies: (optional) Dictionary mapping protocol or protocol and hostname to the URL of the proxy. :param stream: (optional) whether to immediately download the response content. Defaults to ``False``. :param verify: (optional) Either a boolean, in which case it controls whether we verify the server's TLS certificate, or a string, in which case it must be a path to a CA bundle to use. Defaults to ``True``. :param cert: (optional) if String, path to ssl client cert file (.pem). If Tuple, ('cert', 'key') pair. :rtype: requests.Response ) rmrVr9r|r}r~rursr[rt)rFrJ)rrr��merge_environment_settingsrVr-r^)r;rmrVrur}r9r[r|rsrFrJrIrtrErGrHr~r_ZprepZsettingsZsend_kwargsr<r&r&r*rd�s() zSession.requestcKs|jdd�|jd|f|�S)z�Sends a GET request. Returns :class:`Response` object. :param url: URL for the new :class:`Request` object. :param \*\*kwargs: Optional arguments that ``request`` takes. :rtype: requests.Response rJTrk)rhrd)r;rV�kwargsr&r&r*r3szSession.getcKs|jdd�|jd|f|�S)z�Sends a OPTIONS request. Returns :class:`Response` object. :param url: URL for the new :class:`Request` object. :param \*\*kwargs: Optional arguments that ``request`` takes. :rtype: requests.Response rJTZOPTIONS)rhrd)r;rVr�r&r&r*�options!szSession.optionscKs|jdd�|jd|f|�S)z�Sends a HEAD request. Returns :class:`Response` object. :param url: URL for the new :class:`Request` object. :param \*\*kwargs: Optional arguments that ``request`` takes. :rtype: requests.Response rJFrj)rhrd)r;rVr�r&r&r*�head,szSession.headcKs|jd|f||d�|��S)a�Sends a POST request. Returns :class:`Response` object. :param url: URL for the new :class:`Request` object. :param data: (optional) Dictionary, bytes, or file-like object to send in the body of the :class:`Request`. :param json: (optional) json to send in the body of the :class:`Request`. :param \*\*kwargs: Optional arguments that ``request`` takes. :rtype: requests.Response rl)r}r~)rd)r;rVr}r~r�r&r&r*�post7s zSession.postcKs|jd|fd|i|��S)aYSends a PUT request. Returns :class:`Response` object. :param url: URL for the new :class:`Request` object. :param data: (optional) Dictionary, bytes, or file-like object to send in the body of the :class:`Request`. :param \*\*kwargs: Optional arguments that ``request`` takes. :rtype: requests.Response ZPUTr})rd)r;rVr}r�r&r&r*�putCs zSession.putcKs|jd|fd|i|��S)a[Sends a PATCH request. Returns :class:`Response` object. :param url: URL for the new :class:`Request` object. :param data: (optional) Dictionary, bytes, or file-like object to send in the body of the :class:`Request`. :param \*\*kwargs: Optional arguments that ``request`` takes. :rtype: requests.Response ZPATCHr})rd)r;rVr}r�r&r&r*�patchNs z Session.patchcKs|jd|f|�S)z�Sends a DELETE request. Returns :class:`Response` object. :param url: URL for the new :class:`Request` object. :param \*\*kwargs: Optional arguments that ``request`` takes. :rtype: requests.Response ZDELETE)rd)r;rVr�r&r&r*�deleteYszSession.deletec Ks~|jd|j�|jd|j�|jd|j�|jd|j�t|t�rJtd��|jdd�}|j d�}|j }|j|jd�}t �}|j|f|�}t �|} t| d �|_td ||f|�}|jr�x |jD]} t|j| j| j�q�Wt|j||j�|j||f|�}|�r dd�|D�ng}|�r.|jd |�|j�}||_|�sny"t|j||fddi|��|_Wntk �rlYnX|�sz|j|S)zISend a given PreparedRequest. :rtype: requests.Response rErGrHrIz#You can only send PreparedRequests.rJT)rV)Zsecondsr2cSsg|]}|�qSr&r&)r'r<r&r&r*r+�sz Session.send..rr`)rhrErGrHrIr,r� ValueErrorrYr3rt�get_adapterrV�preferred_clockr^r�elapsedrrMrr[rdrPrc�insert�nextZ_next� StopIterationrN) r;rdr�rJrErt�adapter�start�rr�r<�genrMr&r&r*r^csB "zSession.sendc Cs�|jrr|dk r|jd�nd}t||d�}x |j�D]\}} |j|| �q2W|dksZ|dkrrtjjd�pptjjd�}t||j�}t||j �}t||j �}t||j�}||||d�S)z^ Check the environment and merge it with some settings. :rtype: dict Nrf)rfTZREQUESTS_CA_BUNDLEZCURL_CA_BUNDLE)rGrIrErH)rer3rr.rh�os�environr1rIrErGrH) r;rVrIrErGrHrfZenv_proxiesr(r)r&r&r*r��sz"Session.merge_environment_settingscCs:x(|jj�D]\}}|j�j|�r|SqWtd|��dS)z~ Returns the appropriate connection adapter for the given URL. :rtype: requests.adapters.BaseAdapter z*No connection adapters were found for '%s'N)rvr.�lowerrUr)r;rV�prefixr�r&r&r*r��szSession.get_adaptercCs x|jj�D]}|j�qWdS)z+Closes all adapters and as such the sessionN)rv�valuesrT)r;r)r&r&r*rT�sz Session.closecsB||j�<�fdd�|jD�}x|D]}|jj|�|j|<q$WdS)zwRegisters a connection adapter to a prefix. Adapters are sorted in descending order by prefix length. cs g|]}t|�t��kr|�qSr&)rR)r'r()r�r&r*r+�sz!Session.mount..N)rvrY)r;r�r�Zkeys_to_mover0r&)r�r*rw�s z Session.mountcst�fdd��jD��}|S)Nc3s|]}|t�|d�fVqdS)N)�getattr)r'�attr)r;r&r*� �sz'Session.__getstate__..)�dict� __attrs__)r;�stater&)r;r*�__getstate__�szSession.__getstate__cCs&x |j�D]\}}t|||�q WdS)N)r.�setattr)r;r�r��valuer&r&r*�__setstate__�szSession.__setstate__)NNNNNNNTNNNNNN)NN)N)N)rorprq�__doc__r�rxryr{r�rdr3r�r�r�r�r�r�r^r�r�rTrwr�r�r&r&r&r*rrQs2 7) D IrrcCst�S)zQ Returns a :class:`Session` for context-management. :rtype: Session )rrr&r&r&r*�session�sr�)?r�r��platformZtime�collectionsrZdatetimerrsr�compatrrrr r r[rrr rZmodelsrrrrtrrZ_internal_utilsrZutilsrr� exceptionsrrrrZ structuresrrvrrrrr r!r"r#Zstatus_codesr$r%�systemZperf_counterr��AttributeErrorZclockr1r4�objectr5rrr�r&r&r&r*� sB$ r"