�`^c@sdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddlZddlZddl
Z
ddlZyddlmZWn!ek
r�ddlmZnXddlmZmZmZmZmZmZmZmZmZmZmZmZmZm Z ddlm!Z!m"Z"m#Z#m$Z$e
j%d Z&da(de j)d�Z*d�Z+d e,fd
��YZ-de-efd��YZ.ej/d
�Z0d�Z1ddDd��YZ2ddEd��YZ3d�Z4ddFd��YZ5de5fd��YZ6de5fd��YZ7de5fd��YZ8d�Z9de5fd��YZ:ddGd ��YZ;d!e;fd"��YZ<d#dHd$��YZ=d%e=e5fd&��YZ>d'e=e5fd(��YZ?d)�Z@d*dId+��YZAd,e5eAfd-��YZBd.e5eAfd/��YZCd0e5fd1��YZDd2eDfd3��YZEeFed4�r�d5eDfd6��YZGnd7e5fd8��YZHd9e5fd:��YZId;�ZJd<�ZKd=�ZLd>e5fd?��YZMd@e5fdA��YZNdBeNfdC��YZOdS(Js!An extensible library for opening URLs using a variety of protocols
The simplest way to use this module is to call the urlopen function,
which accepts a string containing a URL or a Request object (described
below). It opens the URL and returns the results as file-like
object; the returned object has some extra methods described below.
The OpenerDirector manages a collection of Handler objects that do
all the actual work. Each Handler implements a particular protocol or
option. The OpenerDirector is a composite object that invokes the
Handlers needed to open the requested URL. For example, the
HTTPHandler performs HTTP GET and POST requests and deals with
non-error returns. The HTTPRedirectHandler automatically deals with
HTTP 301, 302, 303 and 307 redirect errors, and the HTTPDigestAuthHandler
deals with digest authentication.
urlopen(url, data=None) -- Basic usage is the same as original
urllib. pass the url and optionally data to post to an HTTP URL, and
get a file-like object back. One difference is that you can also pass
a Request instance instead of URL. Raises a URLError (subclass of
IOError); for HTTP errors, raises an HTTPError, which can also be
treated as a valid response.
build_opener -- Function that creates a new OpenerDirector instance.
Will install the default handlers. Accepts one or more Handlers as
arguments, either instances or Handler classes that it will
instantiate. If one of the argument is a subclass of the default
handler, the argument will be installed instead of the default.
install_opener -- Installs a new opener as the default opener.
objects of interest:
OpenerDirector -- Sets up the User Agent as the Python-urllib client and manages
the Handler classes, while dealing with requests and responses.
Request -- An object that encapsulates the state of a request. The
state can be as simple as the URL. It can also include extra HTTP
headers, e.g. a User-Agent.
BaseHandler --
exceptions:
URLError -- A subclass of IOError, individual protocols have their own
specific subclass.
HTTPError -- Also a valid HTTP response, so you can treat an HTTP error
as an exceptional event or valid response.
internals:
BaseHandler and parent
_call_chain conventions
Example usage:
import urllib2
# set up authentication info
authinfo = urllib2.HTTPBasicAuthHandler()
authinfo.add_password(realm='PDQ Application',
uri='https://mahler:8092/site-updates.py',
user='klem',
passwd='geheim$parole')
proxy_support = urllib2.ProxyHandler({"http" : "http://ahad-haam:3128"})
# build a new opener that adds authentication and caching FTP handlers
opener = urllib2.build_opener(proxy_support, authinfo, urllib2.CacheFTPHandler)
# install it
urllib2.install_opener(opener)
f = urllib2.urlopen('http://www.python.org/')
i�N(tStringIO(tunwraptunquotet splittypet splithosttquotet
addinfourlt splitporttsplittagttoBytest splitattrt
ftpwrappert splitusertsplitpasswdt
splitvalue(t localhostturl2pathnamet
getproxiestproxy_bypassicCs+tdkrt�antj|||�S(N(t_openertNonetbuild_openertopen(turltdatattimeout((s/sys/lib/python2.7/urllib2.pyturlopen{scCs
|adS(N(R(topener((s/sys/lib/python2.7/urllib2.pytinstall_opener�stURLErrorcBseZd�Zd�ZRS(cCs|f|_||_dS(N(targstreason(tselfR((s/sys/lib/python2.7/urllib2.pyt__init__�scCsd|jS(Ns<urlopen error %s>(R(R ((s/sys/lib/python2.7/urllib2.pyt__str__�s(t__name__t
__module__R!R"(((s/sys/lib/python2.7/urllib2.pyR�s t HTTPErrorcBsAeZdZejZd�Zd�Zed��Zd�Z RS(sBRaised when HTTP error occurs, but also acts like non-error returncCsV||_||_||_||_||_|dk rR|j||||�ndS(N(tcodetmsgthdrstfptfilenameRt_HTTPError__super_init(R RR&R'R(R)((s/sys/lib/python2.7/urllib2.pyR!�s cCsd|j|jfS(NsHTTP Error %s: %s(R&R'(R ((s/sys/lib/python2.7/urllib2.pyR"�scCs|jS(N(R'(R ((s/sys/lib/python2.7/urllib2.pyR�scCs|jS(N(R((R ((s/sys/lib/python2.7/urllib2.pytinfo�s(
R#R$t__doc__RR!R+R"tpropertyRR,(((s/sys/lib/python2.7/urllib2.pyR%�s
s:\d+$cCs_|j�}tj|�d}|dkr@|jdd�}ntjd|d�}|j�S(s�Return request-host, as defined by RFC 2965.
Variation from RFC: returned value is lowercased, for convenient
comparison.
ittHost(tget_full_urlturlparset
get_headert_cut_port_retsubtlower(trequestRthost((s/sys/lib/python2.7/urllib2.pytrequest_host�stRequestcBs�eZdided�Zd�Zd�Zd�Zd�Zd�Z d�Z
d�Zd�Zd �Z
d
�Zd�Zd�Zd
�Zd�Zd�Zd�Zdd�Zd�ZRS(cCs�t|�|_t|j�\|_|_d|_d|_d|_d|_||_ i|_
x*|j�D]\}}|j||�qmWi|_
|dkr�t|�}n||_||_dS(N(Rt_Request__originalRt_Request__fragmentRttypeR8tportt_tunnel_hostRtheaderstitemst
add_headertunredirected_hdrsR9torigin_req_hosttunverifiable(R RRR@RDREtkeytvalue((s/sys/lib/python2.7/urllib2.pyR!�s cCs^|d dkrQ|d}ttd|�rQt|d|��t||�Snt|�dS(Nit_Request__r_tget_(thasattrR:tgetattrtAttributeError(R tattrtname((s/sys/lib/python2.7/urllib2.pyt__getattr__�s
cCs|j�rdSdSdS(NtPOSTtGET(thas_data(R ((s/sys/lib/python2.7/urllib2.pyt
get_method�scCs
||_dS(N(R(R R((s/sys/lib/python2.7/urllib2.pytadd_data�scCs
|jdk S(N(RR(R ((s/sys/lib/python2.7/urllib2.pyRR�scCs|jS(N(R(R ((s/sys/lib/python2.7/urllib2.pytget_data�scCs(|jrd|j|jfS|jSdS(Ns%s#%s(R<R;(R ((s/sys/lib/python2.7/urllib2.pyR1�s cCsV|jdkrOt|j�\|_|_|jdkrOtd|j�qOn|jS(Nsunknown url type: %s(R=RRR;t_Request__r_typet
ValueError(R ((s/sys/lib/python2.7/urllib2.pytget_type�s
cCsR|jdkrKt|j�\|_|_|jrKt|j�|_qKn|jS(N(R8RRRVt_Request__r_hostR(R ((s/sys/lib/python2.7/urllib2.pytget_hosts
cCs|jS(N(RY(R ((s/sys/lib/python2.7/urllib2.pytget_selectorscCsJ|jdkr(|jr(|j|_n||_|j|_||_dS(Nthttps(R=R?R8R;RY(R R8R=((s/sys/lib/python2.7/urllib2.pyt set_proxys
cCs|j|jkS(N(RYR;(R ((s/sys/lib/python2.7/urllib2.pyt has_proxyscCs|jS(N(RD(R ((s/sys/lib/python2.7/urllib2.pytget_origin_req_hostscCs|jS(N(RE(R ((s/sys/lib/python2.7/urllib2.pytis_unverifiablescCs||j|j�<dS(N(R@t
capitalize(R RFtval((s/sys/lib/python2.7/urllib2.pyRB!scCs||j|j�<dS(N(RCRa(R RFRb((s/sys/lib/python2.7/urllib2.pytadd_unredirected_header%scCs||jkp||jkS(N(R@RC(R theader_name((s/sys/lib/python2.7/urllib2.pyt
has_header)scCs"|jj||jj||��S(N(R@tgetRC(R Rdtdefault((s/sys/lib/python2.7/urllib2.pyR3-s cCs)|jj�}|j|j�|j�S(N(RCtcopytupdateR@RA(R R(((s/sys/lib/python2.7/urllib2.pytheader_items2sN(R#R$RtFalseR!RORSRTRRRUR1RXRZR[R]R^R_R`RBRcReR3Rj(((s/sys/lib/python2.7/urllib2.pyR:�s( tOpenerDirectorcBsSeZd�Zd�Zd�Zd�Zdejd�Z dd�Z
d�ZRS(cCsMdt}d|fg|_g|_i|_i|_i|_i|_dS(NsPython-urllib/%ss
User-agent(t__version__t
addheadersthandlersthandle_openthandle_errortprocess_responsetprocess_request(R tclient_version((s/sys/lib/python2.7/urllib2.pyR!8s
cCs�t|d�s(tdt|���nt}xet|�D]W}|dkrSq;n|jd�}|| }||d}|jd�r�jd�|d}||d}yt|�}Wntk
r�nX|j j
|i�} | |j |<n]|d kr|}|j} n?|d
kr3|}|j} n!|dkr;|}|j
} nq;| j|g�}
|
rtj|
|�n
|
j|�t}q;W|r�tj|j|�|j|�ndS(
Nt
add_parents%expected BaseHandler instance, got %rtredirect_requesttdo_opent
proxy_opent_iterrorRtresponseR7(sredirect_requestsdo_opens
proxy_open(RJt TypeErrorR=Rktdirtfindt
startswithtintRWRqRfRpRrRst
setdefaulttbisecttinsorttappendtTrueRoRu(R thandlertaddedtmethtitprotocolt conditiontjtkindtlookupRo((s/sys/lib/python2.7/urllib2.pytadd_handlerCsJ
cCsdS(N((R ((s/sys/lib/python2.7/urllib2.pytclosersc GsR|j|d�}x9|D]1}t||�}||�}|dk r|SqWdS(N((RfRKR( R tchainR�t meth_nameRRoR�tfunctresult((s/sys/lib/python2.7/urllib2.pyt_call_chainvs
c
Cs�t|t�r!t||�}n"|}|dk rC|j|�n||_|j�}|d}x8|jj|g�D]!}t ||�}||�}qxW|j
||�} |d}x;|jj|g�D]$}t ||�}||| �} q�W| S(Nt_requestt _response(t
isinstancet
basestringR:RRTRRXRsRfRKt_openRr(
R tfullurlRRtreqR�R�t processorR�R{((s/sys/lib/python2.7/urllib2.pyR�s"
cCss|j|jdd|�}|r%|S|j�}|j|j||d|�}|rZ|S|j|jdd|�S(NRgtdefault_openR�tunknowntunknown_open(R�RpRX(R R�RR�R�((s/sys/lib/python2.7/urllib2.pyR��s
cGs�|d
kr<|jd}|d}d|}d}|}n|j}|d}d}|||f|}|j|�}|r�|S|r�|dd f|}|j|�SdS(NthttpR\is
http_error_%sit_erroriRgthttp_error_default(R�shttps(RqR�(R tprotoRtdictR�thttp_errt orig_argsR�((s/sys/lib/python2.7/urllib2.pyRz�s
N(R#R$R!R�R�R�Rtsockett_GLOBAL_DEFAULT_TIMEOUTRR�Rz(((s/sys/lib/python2.7/urllib2.pyRl7s / csRddl��fd�}t�}tttttttt g}t
td�ra|jt
�nt�}xl|D]d}x[|D]S}||�r�t||�r�|j|�q�q~t||�r~|j|�q~q~WqqWx|D]}|j|�q�x|D]}|j|��q�3|D]+}||�r=|�}n|j|�qW|S(s+Create an opener object from a list of handlers.
The opener will use several default handlers, including support
for HTTP, FTP and when applicable, HTTPS.
If any of the handlers passed as arguments are subclasses of the
default handlers, the default handlers will not be used.
i�Ncst|�jtf�S(N(R�t ClassTypeR=(tobj(ttypes(s/sys/lib/python2.7/urllib2.pytisclass�stHTTPS(R�RltProxyHandlertUnknownHandlertHTTPHandlertHTTPDefaultErrorHandlertHTTPRedirectHandlert
FTPHandlertFileHandlertHTTPErrorProcessorRJthttplibR�tHTTPSHandlertsett
issubclasstaddR�tremoveR�(RoR�Rtdefault_classestskiptklasstcheckth((R�s/sys/lib/python2.7/urllib2.pyR�s2
tBaseHandlercBs)eZdZd�Zd�Zd�ZRS(i�cCs
||_dS(N(tparent(R R�((s/sys/lib/python2.7/urllib2.pyRu�scCsdS(N((R ((s/sys/lib/python2.7/urllib2.pyR��scCs#t|d�stS|j|jkS(Nt
handler_order(RJR�R�(R tother((s/sys/lib/python2.7/urllib2.pyt__lt__�s(R#R$R�RuR�R�(((s/sys/lib/python2.7/urllib2.pyR��s R�cBs#eZdZdZd�ZeZRS(sProcess HTTP error responses.i�cCsd|j|j|j�}}}d|ko7dkns`|jjd|||||�}n|S(Ni�i,R�(R&R'R,R�Rz(R R7R{R&R'R(((s/sys/lib/python2.7/urllib2.pyt
http_responses
(R#R$R-R�R�thttps_response(((s/sys/lib/python2.7/urllib2.pyR�s R�cBseZd�ZRS(cCs"t|j�||||��dS(N(R%R1(R R�R)R&R'R(((s/sys/lib/python2.7/urllib2.pyR�s(R#R$R�(((s/sys/lib/python2.7/urllib2.pyR�sR�cBs:eZdZdZd�Zd�ZeZZZdZ RS(ii
c Cs�|j�}|dkr$|dks<|dkr�|dkr�|jdd �}td
�|jj�D��}t|d|d|j�d
t�St|j �||||��dS(s�Return a Request or None in response to a redirect.
This is called by the http_error_30x methods when a
redirection response is received. If a redirection should
take place, return a new Request to allow http_error_30x to
perform the redirect. Otherwise, raise HTTPError if no-one
else should try to handle this url. Return None if you can't
but another Handler might.
i-i.i/i3RQtHEADRPt s%20css3|])\}}|j�dkr||fVqdS(scontent-lengthscontent-typeN(scontent-lengthscontent-type(R6(t.0tktv((s/sys/lib/python2.7/urllib2.pys <genexpr>1s R@RDREN(i-i.i/i3(sGETR�(i-i.i/(
RStreplaceR�R@RAR:R_R�R%R1( R R�R)R&R'R@tnewurltmt
newheaders((s/sys/lib/python2.7/urllib2.pyRvs
cCs�d|kr"|jd�d}n&d|krD|jd�d}ndStj|�}|jsyt|�}d|d<ntj|�}tj|j�|�}|j�}|jd�p�|jd�p�|jd�s�|||d |||��n|j
||||||�} | dkr*dSt|d
�r�|j
}
| _
|
j|d�|jksyt|
�|jkr�t |j�||j|||��q�ni}
| _
|_
|
j|d�d|
|<|j�|j�|jj| d|j�S(
Ntlocationiturit/ishttp://shttps://sftp://s) - Redirection to url '%s' is not allowedt
redirect_dictiR(t
getheadersR2tpathtlistt
urlunparseturljoinR1R6RR%RvRRJR�Rftmax_repeatstlentmax_redirectionstinf_msgtreadR�R�RR(R R�R)R&R'R@R�turlpartstnewurl_lowertnewtvisited((s/sys/lib/python2.7/urllib2.pythttp_error_302?sB
soThe HTTP server returned a redirect error that would lead to an infinite loop.
The last 30x error message was:
(
R#R$R�R�RvR�thttp_error_301thttp_error_303thttp_error_307R�(((s/sys/lib/python2.7/urllib2.pyR�s " 8c Cs�t|�\}}|jd�s0d}|}nV|jd�sRtd|��n|jdd�}|dkryd}n|d|!}t|�\}}|dk r�t|�\}}n
d}}||||fS(s3Return (scheme, user, password, host/port) given a URL or an authority.
If a URL is supplied, it must have an authority (host:port) component.
According to RFC 3986, having an authority component means the URL must
have two slashes after the scheme:
>>> _parse_proxy('file:/ftp.example.com/')
Traceback (most recent call last):
ValueError: proxy URL with no authority: 'file:/ftp.example.com/'
The first three items of the returned tuple may be None.
Examples of authority parsing:
>>> _parse_proxy('proxy.example.com')
(None, None, None, 'proxy.example.com')
>>> _parse_proxy('proxy.example.com:3128')
(None, None, None, 'proxy.example.com:3128')
The authority component may optionally include userinfo (assumed to be
username:password):
>>> _parse_proxy('joe:[email protected]')
(None, 'joe', 'password', 'proxy.example.com')
>>> _parse_proxy('joe:[email protected]:3128')
(None, 'joe', 'password', 'proxy.example.com:3128')
Same examples, but with URLs instead:
>>> _parse_proxy('http://proxy.example.com/')
('http', None, None, 'proxy.example.com')
>>> _parse_proxy('http://proxy.example.com:3128/')
('http', None, None, 'proxy.example.com:3128')
>>> _parse_proxy('http://joe:[email protected]/')
('http', 'joe', 'password', 'proxy.example.com')
>>> _parse_proxy('http://joe:[email protected]:3128')
('http', 'joe', 'password', 'proxy.example.com:3128')
Everything after the authority is ignored:
>>> _parse_proxy('ftp://joe:[email protected]/rubbish:3128')
('ftp', 'joe', 'password', 'proxy.example.com')
Test for no trailing '/' case:
>>> _parse_proxy('http://joe:[email protected]')
('http', 'joe', 'password', 'proxy.example.com')
R�s//sproxy URL with no authority: %rii�N(RRRRWR~RR
( tproxytschemetr_schemet authoritytendtuserinfothostporttusertpassword((s/sys/lib/python2.7/urllib2.pyt_parse_proxy~s2
R�cBs#eZdZdd�Zd�ZRS(idcCs�|dkrt�}nt|d�s3td��||_x=|j�D]/\}}t|d||||jd��qIWdS(Nthas_keysproxies must be a mappings%s_opencSs||||�S(N((trR�R=R�((s/sys/lib/python2.7/urllib2.pyt<lambda>�s(RRRJtAssertionErrortproxiesRAtsetattrRx(R R�R=R((s/sys/lib/python2.7/urllib2.pyR!�s
cCs�|j�}t|�\}}}}|dkr9|}n|jrUt|j�rUdS|r�|r�dt|�t|�f} tj| �j�}
|j dd|
�nt|�}|j
||�||ks�|dkr�S|jj|d|j
�SdS(Ns%s:%ssProxy-authorizationsBasic R\R(RXR�RR8RRtbase64t b64encodetstripRBR]R�RR(R R�R�R=t orig_typet
proxy_typeR�R�R�t user_passtcreds((s/sys/lib/python2.7/urllib2.pyRx�s N(R#R$R�RR!Rx(((s/sys/lib/python2.7/urllib2.pyR��s
tHTTPPasswordMgrcBs8eZd�Zd�Zd�Zed�Zd�ZRS(cCs
i|_dS(N(tpasswd(R ((s/sys/lib/python2.7/urllib2.pyR!�scCs�t|t�r|g}n||jkr:i|j|<nxVttfD]H}tg|D]}|j||�^qW�}||f|j||<qGWdS(N(R�R�RR�Rkttuplet
reduce_uri(R trealmR�R�Rtdefault_porttutreduced_uri((s/sys/lib/python2.7/urllib2.pytadd_password�s(c Cs�|jj|i�}xjttfD]\}|j||�}xA|j�D]3\}}x$|D]}|j||�rZ|SqZWqGWq"WdS(N(NN(RRfR�RkRt iteritemst is_suburiR( R RtauthuritdomainsRtreduced_authurituristauthinfoR�((s/sys/lib/python2.7/urllib2.pytfind_user_passwords
c
Cs�tj|�}|dr@|d}|d}|dp:d}nd
}|}d}t|�\}}|r�|d
kr�|d
k r�idd6dd6j|�} | d
k r�d || f}q�n||fS(s@Accept authority or URI and extract only the authority and path.iiiR�iPR�i�R\s%s:%dN(R2turlsplitRRRf(
R R�RtpartsR�R�R�R8R>tdport((s/sys/lib/python2.7/urllib2.pyRs
cCsi||krtS|d|dkr(tStj|d|df�}t|�t|d�kretStS(scCheck if test is below base in a URI tree
Both args must be URIs in reduced form.
ii(R�Rkt posixpathtcommonprefixR�(R tbasettesttcommon((s/sys/lib/python2.7/urllib2.pyR "s(R#R$R!RRR�RR (((s/sys/lib/python2.7/urllib2.pyR��s
tHTTPPasswordMgrWithDefaultRealmcBseZd�ZRS(cCsDtj|||�\}}|dk r1||fStj|d|�S(N(R�RR(R RR
R�R�((s/sys/lib/python2.7/urllib2.pyR3s
(R#R$R(((s/sys/lib/python2.7/urllib2.pyR1stAbstractBasicAuthHandlercBsDeZejdej�Zdd�Zd�Zd�Z d�Z
RS(s1(?:.*,)*[ ]*([^ ]+)[ ]+realm=(["']?)([^"']*)\2cCs=|dkrt�}n||_|jj|_d|_dS(Ni(RR�RRtretried(R tpassword_mgr((s/sys/lib/python2.7/urllib2.pyR!Is
cCs
d|_dS(Ni(R(R ((s/sys/lib/python2.7/urllib2.pytreset_retry_countPsc
Cs�|j|d�}|jdkrBt|j�dd|d��n|jd7_|r�jj|�}|r�j�\}}}|dkr�t j
dtd�n|j�d kr�j
|||�} | r� jdkr�
|_n| Sq�dS(Nii�sbasic auth failedit"t'sBasic Auth Realm was unquoteditbasici(RR(RfRRR%R1RtrxtsearchtgroupstwarningstwarntUserWarningR6tretry_http_basic_authR&(
R tauthreqR8R�R@tmoR�RRR{((s/sys/lib/python2.7/urllib2.pythttp_error_auth_reqedSs"
cCs�|jj||�\}}|dk r�d||f}dtj|�j�}|jj|jd�|krrdS|j |j|�|j
j|d|j�SdSdS(Ns%s:%ssBasic %sR(
RRRR�R�R�R@Rftauth_headerRcR�RR(R R8R�RR�tpwtrawtauth((s/sys/lib/python2.7/urllib2.pyR&msN(R#R$tretcompiletIR RR!RR)R&(((s/sys/lib/python2.7/urllib2.pyR;s tHTTPBasicAuthHandlercBseZdZd�ZRS(t
AuthorizationcCs2|j�}|jd|||�}|j�|S(Nswww-authenticate(R1R)R(R R�R)R&R'R@RR{((s/sys/lib/python2.7/urllib2.pythttp_error_401~s
(R#R$R*R3(((s/sys/lib/python2.7/urllib2.pyR1zstProxyBasicAuthHandlercBseZdZd�ZRS(sProxy-authorizationcCs2|j�}|jd|||�}|j�|S(Nsproxy-authenticate(RZR)R(R R�R)R&R'R@R�R{((s/sys/lib/python2.7/urllib2.pythttp_error_407�s
(R#R$R*R5(((s/sys/lib/python2.7/urllib2.pyR4�scCs}tjjd�r;td�}|j|�}|j�|Sgt|�D]}ttj dd��^qH}dj
|�SdS(sReturn n random bytes.s/dev/urandomiiR/N(tosR�texistsRR�R�trangetchrtrandomt randrangetjoin(tntftsR�tL((s/sys/lib/python2.7/urllib2.pytrandombytes�s
1tAbstractDigestAuthHandlercBsSeZdd�Zd�Zd�Zd�Zd�Zd�Zd�Z d�Z
RS( cCsO|dkrt�}n||_|jj|_d|_d|_d|_dS(Ni(RR�RRRtnonce_countt
last_nonce(R R((s/sys/lib/python2.7/urllib2.pyR!�s cCs
d|_dS(Ni(R(R ((s/sys/lib/python2.7/urllib2.pyR�scCs�|j|d�}|jdkrBt|j�dd|d��n|jd7_|r�|j�d}|j�dkr�|j||�SndS(Nii�sdigest auth failediitdigest(RfRRR%R1tsplitR6tretry_http_digest_auth(R R*R8R�R@R'R�((s/sys/lib/python2.7/urllib2.pyR)�scCs�|jdd�\}}tt|��}|j||�}|r�d|}|jj|jd�|krndS|j|j|�|j j
|d|j�}|SdS(NR�is Digest %sR(RFtparse_keqv_listtparse_http_listtget_authorizationR@RfR*RRcR�RR(R R�R-ttokent challengetchaltauth_valtresp((s/sys/lib/python2.7/urllib2.pyRG�s
cCs<tjd|j|tj�td�f�j�}|d S(Ns%s:%s:%s:%sii(thashlibtsha1RCttimetctimeRAt hexdigest(R tnoncetdig((s/sys/lib/python2.7/urllib2.pyt
get_cnonce�scCsdyK|d}|d}|jd�}|jdd�}|jdd�}Wntk
r_dSX|j|�\}} |dkr�dS|jj||j��\}
}|
dkr�dS|j�r�|j|j �|�}nd}d|
||f}
d|j
�|j�f}|d kr�||jkr?|j
d
7_
nd
|_
||_d|j
}|j|�}d||||||�f}| ||
�|�}nD|dkr�| ||
�d|||�f�}ntd
|��d|
|||j�|f}|r|d|7}n|r5|d|7}n|d|7}|r`|d||f7}n|S(NRRUtqopt algorithmtMD5topaques%s:%s:%ss%s:%sR-is%08xs%s:%s:%s:%s:%ssqop '%s' is not supported.s>username="%s", realm="%s", nonce="%s", uri="%s", response="%s"s
, opaque="%s"s
, digest="%s"s, algorithm="%s"s, qop=auth, nc=%s, cnonce="%s"(RfRtKeyErrortget_algorithm_implsRRR1RRtget_entity_digestRURSR[RDRCRWR(R R�RMRRURXRYR[tHtKDR�R+tentdigtA1tA2tncvaluetcnoncetnoncebittrespdigR((s/sys/lib/python2.7/urllib2.pyRJ�sV
!
(
csU|j�}|dkr$d��n|dkr<d��n�fd�}�|fS(NRZcSstj|�j�S(N(RPtmd5RT(tx((s/sys/lib/python2.7/urllib2.pyR�$stSHAcSstj|�j�S(N(RPRQRT(Ri((s/sys/lib/python2.7/urllib2.pyR�&scs�d||f�S(Ns%s:%s((R?td(R_(s/sys/lib/python2.7/urllib2.pyR�(s(tupper(R RYR`((R_s/sys/lib/python2.7/urllib2.pyR]scCsdS(N(R(R RRM((s/sys/lib/python2.7/urllib2.pyR^+sN(R#R$RR!RR)RGRWRJR]R^(((s/sys/lib/python2.7/urllib2.pyRB�s
= tHTTPDigestAuthHandlercBs#eZdZdZdZd�ZRS(s�An authentication protocol defined by RFC 2069
Digest authentication improves on basic authentication because it
does not transmit passwords in the clear.
R2i�cCs?tj|j��d}|jd|||�}|j�|S(Niswww-authenticate(R2R1R)R(R R�R)R&R'R@R8tretry((s/sys/lib/python2.7/urllib2.pyR3:s
(R#R$R-R*R�R3(((s/sys/lib/python2.7/urllib2.pyRm0stProxyDigestAuthHandlercBseZdZdZd�ZRS(sProxy-Authorizationi�cCs2|j�}|jd|||�}|j�|S(Nsproxy-authenticate(RZR)R(R R�R)R&R'R@R8Rn((s/sys/lib/python2.7/urllib2.pyR5Gs
(R#R$R*R�R5(((s/sys/lib/python2.7/urllib2.pyRoBstAbstractHTTPHandlercBs/eZdd�Zd�Zd�Zd�ZRS(icCs
||_dS(N(t_debuglevel(R t
debuglevel((s/sys/lib/python2.7/urllib2.pyR!PscCs
||_dS(N(Rq(R tlevel((s/sys/lib/python2.7/urllib2.pytset_http_debuglevelSsc
Cs:|j�}|s!td��n|j�r�|j�}|jd�s[|jdd�n|jd�s�|jddt|��q�n|}|j�r�t|j ��\}}t
|�\}}n|jd�s�jd|�nxH|jjD]:\}} |j
�}|j|�s�j|| �q�W|S(Ns
no host givensContent-types!application/x-www-form-urlencodedsContent-lengths%dR0(RZRRRRUReRcR�R^RR[RR�RnRa(
R R7R8Rtsel_hostR�tseltsel_pathRNRG((s/sys/lib/python2.7/urllib2.pytdo_request_Vs.
cs�|j�}|s!td��n||d|j�}|j|j�t|j���jt�fd�|jj �D���d�d<td��j �D���|j
r�}d}|�kr�|||<�|=n|j|j
d|�ny)|j|j
�|j�|j��Wn,tjk
rP}|j�t|��n7Xy|jd t�}Wntk
r�|j�}nX|j|_tj|dt�} t| |j|j��}
|j|
_|j|
_|
S(
s�Return an addinfourl object for the request, using http_class.
http_class must implement the HTTPConnection API from httplib.
The addinfourl return value is a file-like object. It also
has methods and attributes including:
- info(): return a mimetools.Message object for the headers
- geturl(): return the original request URL
- code: HTTP status code
s
no host givenRc3s-|]#\}}|�kr||fVqdS(N((R�R�R�(R@(s/sys/lib/python2.7/urllib2.pys <genexpr>�s R�t
Connectioncss'|]\}}|j�|fVqdS(N(ttitle(R�RNRb((s/sys/lib/python2.7/urllib2.pys <genexpr>�ssProxy-AuthorizationR@t buffering(RZRRtset_debuglevelRqR�RCRiR@RAR?t
set_tunnelR7RSR[RR�RzR�tgetresponseR�R|R�trecvt_fileobjectRR'R1tstatusR&R(R t
http_classR�R8R�ttunnel_headerstproxy_auth_hdrterrR�R)RO((R@s/sys/lib/python2.7/urllib2.pyRwss@
,
)
(R#R$R!RtRxRw(((s/sys/lib/python2.7/urllib2.pyRpNs R�cBseZd�ZejZRS(cCs|jtj|�S(N(RwR�tHTTPConnection(R R�((s/sys/lib/python2.7/urllib2.pyt http_open�s(R#R$R�RpRxthttp_request(((s/sys/lib/python2.7/urllib2.pyR��s R�R�cBseZd�ZejZRS(cCs|jtj|�S(N(RwR�tHTTPSConnection(R R�((s/sys/lib/python2.7/urllib2.pyt
https_open�s(R#R$R�RpRxt
https_request(((s/sys/lib/python2.7/urllib2.pyR��s tHTTPCookieProcessorcBs2eZdd�Zd�Zd�ZeZeZRS(cCs4ddl}|dkr'|j�}n||_dS(Ni�(t cookielibRt CookieJart cookiejar(R R�R�((s/sys/lib/python2.7/urllib2.pyR!�scCs|jj|�|S(N(R�tadd_cookie_header(R R7((s/sys/lib/python2.7/urllib2.pyR��scCs|jj||�|S(N(R�textract_cookies(R R7R{((s/sys/lib/python2.7/urllib2.pyR��sN(R#R$RR!R�R�R�R�(((s/sys/lib/python2.7/urllib2.pyR��s
R�cBseZd�ZRS(cCs |j�}td|��dS(Nsunknown url type: %s(RXR(R R�R=((s/sys/lib/python2.7/urllib2.pyR��s(R#R$R�(((s/sys/lib/python2.7/urllib2.pyR��scCsmi}x`|D]X}|jdd�\}}|ddkr[|ddkr[|dd!}n|||<q
W|S(s>Parse list of key=value strings where keys are not duplicated.t=iiRi�(RF(tltparsedteltR�R�((s/sys/lib/python2.7/urllib2.pyRH�s
cCs�g}d}t}}x�|D]�}|r?||7}t}qn|r�|dkr]t}qn|dkrrt}n||7}qn|dkr�|j|�d}qn|dkr�t}n||7}qW|r�j|�ng|D]}|j�^q�(spParse lists as described by RFC 2068 Section 2.
In particular, parse comma-separated lists where the elements of
the list may include quoted-strings. A quoted-string could
contain a comma. A non-quoted string could have quotes in the
middle. Neither commas nor quotes count if they are escaped.
Only double-quotes count, not single-quotes.
R/s\Rt,(RkR�R�R�(R?trestparttescapeRtcur((s/sys/lib/python2.7/urllib2.pyRI�s4
cCs-ytj|�SWntjk
r(dSXdS(N(R�t
gethostbynametgaierrorR(R8((s/sys/lib/python2.7/urllib2.pyt_safe_gethostbynamesR�cBs)eZd�ZdZd�Zd�ZRS(cCsq|j�}|d dkr`|dd!dkr`|jr`|jdkr`d|_|jj|�S|j|�SdS(Nis//iR�Rtftp(R[R8R=R�Rtopen_local_file(R R�R((s/sys/lib/python2.7/urllib2.pyt file_opens, cCs|tjdkruy7ttjd�dtjtj��d�t_Wqutjk
rqtjd�ft_quXntjS(NRi( R�tnamesRRR�tgethostbyname_extgethostnameR�R�(R ((s/sys/lib/python2.7/urllib2.pyt get_names)s$cCs[ddl}ddl}|j�}|j�}t|�}y�j|�}|j}|jj |j
dt�} |j|�d}
t
jtd|
p�d|| f��}|r�t|�\}}n|s�r(t|�|j�kr(|rd||}
n
d|}
tt|d�||
�SWntk
rJ}t|��nXtd��dS( Ni�tusegmtis6Content-type: %s
Content-length: %d
Last-modified: %s
s
text/plainsfile://trbsfile not on local host(temail.utilst mimetypesRZR[RR6tstattst_sizetutilst
formatdatetst_mtimeR�t
guess_typet mimetoolstMessageRRR�R�RRtOSErrorR(R R�temailR�R8R*t localfiletstatstsizetmodifiedtmtypeR@R>torigurlR'((s/sys/lib/python2.7/urllib2.pyR�4s0
N(R#R$R�RR�R�R�(((s/sys/lib/python2.7/urllib2.pyR�s
R�cBseZd�Zd�ZRS(cCs�ddl}ddl}|j�}|s9td��nt|�\}}|dkrc|j}nt|�}t|�\}}|r�t |�\}}nd}t
|�}|p�d}|p�d}ytj|�}Wn"tj
k
r�t|��nXt|j��\} }
| jd�}tt
|�}|d |d}}|rg|drg|d}ny/|j||||||j�}
|r�dp�d}xM|
D]E}t|�\}}|j�d kr�|dkr�|j�}q�q�W|
j||�\}}d}|j|j��d}|r;|d|7}n|dk rd|dkrd|d|7}nt|�}tj|�}t|||j��SWn0|jk
r�}td|tj �d�nXdS(Ni�sftp error: no host givenR/R�iiR0tDR=tatAR�RksContent-type: %s
sContent-length: %d
s
ftp error: %si(R�R�R�R0RkR�(!tftplibR�RZRRRtFTP_PORTR�RR
RR�R�RzR
R[RFtmaptconnect_ftpRRR6RltretrfileR�R1RR�R�Rt
all_errorstsystexc_info(R R�R�R�R8R>R�RR'R�tattrstdirstfiletfwR=RMRGR)tretrlenR@R�tsf((s/sys/lib/python2.7/urllib2.pytftp_openQs\
!
c Cs%t||||||dt�}|S(Nt
persistent(RRk(R R�RR8R>R�RR�((s/sys/lib/python2.7/urllib2.pyR��s (R#R$R�R�(((s/sys/lib/python2.7/urllib2.pyR�Ps 5tCacheFTPHandlercBs>eZd�Zd�Zd�Zd�Zd�Zd�ZRS(cCs1i|_i|_d|_d|_d|_dS(Nii<i(tcacheRtsoonesttdelayt max_conns(R ((s/sys/lib/python2.7/urllib2.pyR!�s
cCs
||_dS(N(R�(R tt((s/sys/lib/python2.7/urllib2.pyt
setTimeout�scCs
||_dS(N(R�(R R�((s/sys/lib/python2.7/urllib2.pytsetMaxConns�scCs�|||dj|�|f}||jkrJtj�|j|j|<n<t||||||�|j|<tj�|j|j|<|j�|j|S(NR�(R<R�RRR�RRtcheck_cache(R R�RR8R>R�RRF((s/sys/lib/python2.7/urllib2.pyR��s"
cCstj�}|j|krrxT|jj�D]@\}}||kr+|j|j�|j|=|j|=q+q+Wnt|jj��|_t|j�|j krxD|jj�D]3\}}||jkr�|j|=|j|=Pq�q�Wt|jj��|_ndS(N(
RRR�RRAR�R�tmintvaluesR�R�(R R�R�R�((s/sys/lib/python2.7/urllib2.pyR��s
cCsBx!|jj�D]}|j�qW|jj�|jj�dS(N(R�R�R�tclearR(R tconn((s/sys/lib/python2.7/urllib2.pytclear_cache�s
(R#R$R!R�R�R�R�R�(((s/sys/lib/python2.7/urllib2.pyR��s
(((((((PR-R�RPR�R�R6RR:R.R�R�RRR2R�R#t cStringIORtImportErrorturllibRRRRRRRRR R
RRR
RRRRRtversionRmRRR�RRtIOErrorRR%R/R4R9R:RlRR�R�R�R�R�R�R�RRR1R4RARBRmRoRpR�RJR�R�R�RHRIR�R�R�R�(((s/sys/lib/python2.7/urllib2.pyt<module>Lst
^"
r�'i H+@
? �m
+ 4<
|