YЅ_c@sdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z ddl mZddlmZddlmZmZmZmZmZmZmZmZmZmZmZmZddlmZm Z dd l!m"Z"dd l#m$Z$efZ%d8Z&ej'Z(id d6dd6Z)dZ*dZ+dZ,dZ-dZ.dZ/dZ0dZ1e2dZ3dZ4dZ5dZ6dZ7dZ8dZ9d Z:e;d!d"Z<d#Z=d$Z>d%Z?d&Z@d'ZAd(ZBd)ZCd*ZDd+d,ZEd-ZFd.ZGd/jHd0ZIeId1ZJeId2ZKd3ZLd4ZMd5ZNd0d6ZOd7ZPdS(9s requests.utils ~~~~~~~~~~~~~~ This module provides utility functions that are used within Requests that are also useful for external consumption. iNi(t __version__(tcerts(tparse_http_list( tquoteturlparsetbyteststrt OrderedDicttunquotetis_py2t builtin_strt getproxiest proxy_bypasst urlunparset basestring(tRequestsCookieJartcookiejar_from_dict(tCaseInsensitiveDict(t InvalidURLs.netrct_netrciPthttpithttpscCs"t|dr|j}n|S(s/Returns an internal sequence dictionary update.titems(thasattrR(td((s2/usr/lib/python2.7/site-packages/requests/utils.pytdict_to_sequence+scCst|drt|St|dr/|jSt|drxy|j}Wntjk rdqxXtj|jSnt|drt|jSdS(Nt__len__tlentfilenotgetvalue( RRRtiotUnsupportedOperationtostfstattst_sizeR(toR((s2/usr/lib/python2.7/site-packages/requests/utils.pyt super_len4s c Cs2yddlm}m}d}x^tD]V}ytjjdj|}Wntk r_dSXtjj |r&|}Pq&q&W|dkrdSt |}|j j dd}yG||j |}|r|drdnd} || |dfSWn|tfk rnXWnttfk r-nXdS( s;Returns the Requests tuple auth for a given url from netrc.i(tnetrctNetrcParseErrors~/{0}Nt:iii(R%R&tNonet NETRC_FILESR tpatht expandusertformattKeyErrortexistsRtnetloctsplittauthenticatorstIOErrort ImportErrortAttributeError( turlR%R&t netrc_pathtftloctrithostRtlogin_i((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_netrc_authHs0    cCs[t|dd}|rWt|trW|ddkrW|ddkrWtjj|SdS(s0Tries to guess the filename of the given object.tnameitN(tgetattrR(t isinstanceRR R*tbasename(tobjR=((s2/usr/lib/python2.7/site-packages/requests/utils.pytguess_filenamevs%cCsD|dkrdSt|ttttfr:tdnt|S(sTake an object and test to see if it can be represented as a dictionary. Unless it can not be represented as such, return an OrderedDict, e.g., :: >>> from_key_val_list([('key', 'val')]) OrderedDict([('key', 'val')]) >>> from_key_val_list('string') ValueError: need more than 1 value to unpack >>> from_key_val_list({'key': 'val'}) OrderedDict([('key', 'val')]) s+cannot encode objects that are not 2-tuplesN(R(RARRtbooltintt ValueErrorR(tvalue((s2/usr/lib/python2.7/site-packages/requests/utils.pytfrom_key_val_list~s  cCse|dkrdSt|ttttfr:tdnt|tjr[|j }nt |S(szTake an object and test to see if it can be represented as a dictionary. If it can be, return a list of tuples, e.g., :: >>> to_key_val_list([('key', 'val')]) [('key', 'val')] >>> to_key_val_list({'key': 'val'}) [('key', 'val')] >>> to_key_val_list('string') ValueError: cannot encode objects that are not 2-tuples. s+cannot encode objects that are not 2-tuplesN( R(RARRRERFRGt collectionstMappingRtlist(RH((s2/usr/lib/python2.7/site-packages/requests/utils.pytto_key_val_lists cCshg}x[t|D]M}|d |dko8dknrSt|dd!}n|j|qW|S(sParse lists as described by RFC 2068 Section 2. In particular, parse comma-separated lists where the elements of the list may include quoted-strings. A quoted-string could contain a comma. A non-quoted string could have quotes in the middle. Quotes are removed automatically after parsing. It basically works like :func:`parse_set_header` just that items may appear multiple times and case sensitivity is preserved. The return value is a standard :class:`list`: >>> parse_list_header('token, "quoted value"') ['token', 'quoted value'] To create a header from the :class:`list` again, use the :func:`dump_header` function. :param value: a string with a list header. :return: :class:`list` iit"(t_parse_list_headertunquote_header_valuetappend(RHtresulttitem((s2/usr/lib/python2.7/site-packages/requests/utils.pytparse_list_headers $cCsi}xt|D]~}d|kr5d||>> d = parse_dict_header('foo="is a fish", bar="as well"') >>> type(d) is dict True >>> sorted(d.items()) [('bar', 'as well'), ('foo', 'is a fish')] If there is no value for a key it will be `None`: >>> parse_dict_header('key_without_value') {'key_without_value': None} To create a header from the :class:`dict` again, use the :func:`dump_header` function. :param value: a string with a dict header. :return: :class:`dict` t=iiRNN(ROR(R0RP(RHRRRSR=((s2/usr/lib/python2.7/site-packages/requests/utils.pytparse_dict_headers  $cCsq|rm|d|dko%dknrm|dd!}| sN|d dkrm|jddjddSn|S( sUnquotes a header value. (Reversal of :func:`quote_header_value`). This does not use the real unquoting but what browsers are actually using for quoting. :param value: the header value to unquote. iiRNiis\\s\s\"(treplace(RHt is_filename((s2/usr/lib/python2.7/site-packages/requests/utils.pyRPs * cCs+i}x|D]}|j||j]tflagss+]s$^<\?xml.*?encoding=["\']*(.+?)["\'>](twarningstwarntDeprecationWarningtretcompiletItfindall(tcontentt charset_ret pragma_retxml_re((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_encodings_from_content"scCs_|jd}|sdStj|\}}d|krK|djdSd|kr[dSdS(smReturns encodings from given HTTP Header Dict. :param headers: dictionary to extract encoding from. s content-typetcharsets'"ttexts ISO-8859-1N(tgetR(tcgit parse_headertstrip(theaderst content_typetparams((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_encoding_from_headers6s  ccs|jdkr)x|D] }|VqWdStj|jdd}x+|D]#}|j|}|rK|VqKqKW|jddt}|r|VndS(sStream decodes a iterator.NterrorsRWttfinal(tencodingR(tcodecstgetincrementaldecodertdecodetTrue(titeratortrRStdecodertchunktrv((s2/usr/lib/python2.7/site-packages/requests/utils.pytstream_decode_response_unicodeJs    ccs=d}x0|t|kr8||||!V||7}q WdS(s Iterate over slices of a string.iN(R(tstringt slice_lengthtpos((s2/usr/lib/python2.7/site-packages/requests/utils.pyt iter_slices\scCstjdtg}t|j}|rcyt|j|SWqctk r_|j|qcXnyt|j|ddSWnt k r|jSXdS(sReturns the requested content back in unicode. :param r: Response object to get unicode content from. Tried: 1. charset from content-type 2. fall back and replace all unicode characters sIn requests 3.0, get_unicode_from_response will be removed. For more information, please see the discussion on issue #2266. (This warning should only appear once.)RwRWN( RaRbRcRvRsRRht UnicodeErrorRQt TypeError(Rttried_encodingsRz((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_unicode_from_responseds   t4ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyzs0123456789-._~cCs|jd}xtdt|D]}||dd!}t|dkr|jrytt|d}Wn!tk rtd|nX|tkr|||d||dA}tjtjd|S(st Converts mask from /xx format to xxx.xxx.xxx.xxx Example: if mask is 24 function returns 255.255.255.0 lii s>I(Rt inet_ntoaRtpack(tmaskR((s2/usr/lib/python2.7/site-packages/requests/utils.pyRscCs-ytj|Wntjk r(tSXtS(N(RRterrortFalseR~(t string_ip((s2/usr/lib/python2.7/site-packages/requests/utils.pytis_ipv4_addresss cCs|jddkryt|jdd}Wntk rFtSX|dks_|dkrctSytj|jddWqtjk rtSXntStS(s9Very simple check of the cidr format in no_proxy variableRii i( tcountRFR0RGRRRRR~(tstring_networkR((s2/usr/lib/python2.7/site-packages/requests/utils.pyt is_valid_cidrs cCsd}|d}t|j}|r|jddjd}|jdd}t|rxs|D](}t|rkt||rtSqkqkWqx@|D]5}|j|s|jddj|rtSqWnyt |}Wn t t j fk rt }nX|rtSt S(s: Returns whether we should bypass proxies or not. cSs(tjj|p'tjj|jS(N(R tenvironRotupper(tk((s2/usr/lib/python2.7/site-packages/requests/utils.pytstno_proxyt Rxt,R'i(RR/RWR0RRRR~tendswithR RRtgaierrorR(R5t get_proxyRR/Rtproxy_ipR:tbypass((s2/usr/lib/python2.7/site-packages/requests/utils.pytshould_bypass_proxiess*      +  cCst|riStSdS(s%Return a dict of environment proxies.N(RR (R5((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_environ_proxiess spython-requestscCs7tj}|dkr'tj}n|dkrdtjjtjjtjjf}tjjdkrdj |tjjg}qn<|dkrtj}n!|dkrtj}nd}ytj }tj }Wnt k rd}d}nXd j d |t fd ||fd ||fgS( s4Return a string representing the default user agent.tCPythontPyPys%s.%s.%sRyRxtJythont IronPythontUnknownRs%s/%s(tplatformtpython_implementationtpython_versiontsystpypy_version_infotmajortminortmicrot releaselevelRtsystemtreleaseR2R(R=t_implementationt_implementation_versiontp_systemt p_release((s2/usr/lib/python2.7/site-packages/requests/utils.pytdefault_user_agents.     !      cCs2titd6djd d6dd6dd 6S( Ns User-Agents, tgziptdeflatesAccept-Encodings*/*tAccepts keep-alivet Connection(RR(RRR(((s2/usr/lib/python2.7/site-packages/requests/utils.pytdefault_headers=s  c Csg}d}xtjd|D]}y|jdd\}}Wntk ra|d}}nXi}|jd|d; rel=front; type="image/jpeg",; rel=back;type="image/jpeg" s '"s, * '"R5RU(RdR0RGRrRQ( RHtlinkst replace_charstvalR5Rutlinktparamtkey((s2/usr/lib/python2.7/site-packages/requests/utils.pytparse_header_linksFs"   ttasciiiicCs|d }|tjtjfkr&dS|d tjkr=dS|d tjtjfkr]dS|jt}|dkr|dS|dkr|dddtkrd S|d ddtkrd Sn|dkr|d t krd S|d t krd SndS(Nisutf-32is utf-8-sigisutf-16isutf-8s utf-16-beis utf-16-les utf-32-bes utf-32-le( R{t BOM_UTF32_LEtBOM32_BEtBOM_UTF8t BOM_UTF16_LEt BOM_UTF16_BERt_nullt_null2t_null3R((tdatatsamplet nullcount((s2/usr/lib/python2.7/site-packages/requests/utils.pytguess_json_utfns*    cCsSt||\}}}}}}|s7||}}nt||||||fS(sGiven a URL that may or may not have a scheme, prepend the given scheme. Does not replace a present scheme with the one provided as an argument.(RR (R5t new_schemetschemeR/R*Rutquerytfragment((s2/usr/lib/python2.7/site-packages/requests/utils.pytprepend_scheme_if_neededs!cCsRt|}y"t|jt|jf}Wnttfk rMd}nX|S(s_Given a url with authentication components, extract them into a tuple of username,password.Rx(RxRx(RRtusernametpasswordR4R(R5tparsedtauth((s2/usr/lib/python2.7/site-packages/requests/utils.pytget_auth_from_urls  " cCsId}t|tr|}n'tr6|j|}n|j|}|S(s Given a string object, regardless of type, returns a representation of that string in the native string type, encoding and decoding where necessary. This assumes ASCII unless told otherwise. N(R(RAR R tencodeR}(RRztout((s2/usr/lib/python2.7/site-packages/requests/utils.pytto_native_strings cCsft|\}}}}}}|s4||}}n|jddd}t|||||dfS(sE Given a url remove the fragment and the authentication part t@iiRx(RtrsplitR (R5RR/R*RuRR((s2/usr/lib/python2.7/site-packages/requests/utils.pyt urldefragauths (s.netrcs_netrc(Qt__doc__RpR{RJRR RRdRRRRaRxRRtcompatRRORRRRRRR R R R R RtcookiesRRt structuresRt exceptionsRt_hush_pyflakesR)twheretDEFAULT_CA_BUNDLE_PATHt DEFAULT_PORTSRR$R<RDRIRMRTRVRRPR\R_RlRvRRRt frozensetRRRRRRRRRRRRRRRRRRRRR(((s2/usr/lib/python2.7/site-packages/requests/utils.pyt sx           R    .     "       $      -   #