File: //proc/2/root/usr/lib/python2.4/cookielib.pyc
m
=5Dc @ s d Z d k Z d k Z d k Z d k Z d k Z d k Z d k Z d k l Z y
d k
Z Wn e j
o d k
Z n Xd k Z d k l Z e i d i Z e e i Z d Z f d Z d Z d Z d d
d d d
d d g Z d d d d d d d d d d d d g Z g Z x! e D] Z e i e i q(We d Z! e d Z" h d e <d e <d e <d! e <Z# e i$ d" Z% d# Z& d$ Z' e i$ d% Z( e i$ d& e i) Z* e i$ d' e i+ Z, d( Z- e i$ d) e i+ Z. d* Z/ d+ Z0 e i$ d, Z1 e i$ d- Z2 e i$ d. Z3 e i$ d/ Z4 d0 Z5 e i$ d1 Z6 d2 Z7 d3 Z8 e i$ d4 Z9 d5 Z: d6 Z; d7 Z< d8 Z= e i$ d9 Z> d: Z? d; Z@ d< ZA d= ZB d> ZC e i$ d? ZD d@ ZE dA ZF dB ZG dC ZH dD f dE YZI dF f dG YZJ dH eJ f dI YZK dJ ZL dK ZM dL f dM YZN dN f dO YZO dP eP f dQ YZQ dR eO f dS YZR dT kS lT ZT lU ZU dU kV lW ZW d S(V s HTTP cookie handling for web clients.
This module has (now fairly distant) origins in Gisle Aas' Perl module
HTTP::Cookies, from the libwww-perl library.
Docstrings, comments and debug strings in this code refer to the
attributes of the HTTP cookie system as cookie-attributes, to distinguish
them clearly from Python attributes.
Class diagram (note that the classes which do not derive from
FileCookieJar are not distributed with the Python standard library, but
are available from http://wwwsearch.sf.net/):
CookieJar____
/ \ FileCookieJar \ / | \ \ MozillaCookieJar | LWPCookieJar \ | | | ---MSIEBase | | / | | | / MSIEDBCookieJar BSDDBCookieJar
|/
MSIECookieJar
N( s StringTypes( s timegmt cookielibsQ a filename was not supplied (nor was the CookieJar instance initialised with one)c C s | t t t f } t i d } t | | o n d k } d k } d k
} | i
} | i d | | i } | i d | d d d S( Ni s cookielib bug!
%st
stackleveli ( t unmaskedt KeyboardInterruptt
SystemExitt MemoryErrort syst exc_infot etypet
issubclasst warningst tracebackt StringIOt ft print_exct Nonet getvaluet msgt warn( R R
R
R R R R ( ( t /usr/lib/python2.4/cookielib.pyt reraise_unmasked_exceptions+ s i c C s | d \ } } } } } } | t j o d | j o
d j n o d | j o
d j n oh d | j o
d j n oJ d | j o
d j n o, d | j o
d j n o t | Sn d Sd S( Ni i i i i i i; i= (
t ttt yeart montht mdayt hourt mint sect
EPOCH_YEARt timegmR ( R R R R R R R ( ( R t _timegm? s t Mont Tuet Wedt Thut Frit Satt Sunt Jant Febt Mart Aprt Mayt Junt Jult Augt Sept Octt Novt Decc C s\ | d j o t i } n t i | d \ } } } } } } d | | | | | | f S( sH Return a string representing time in seconds since epoch, t.
If the function is called without an argument, it will use the current
time.
The format of the returned string is like "YYYY-MM-DD hh:mm:ssZ",
representing Universal Time (UTC, aka GMT). An example of this format is:
1994-11-24 08:49:37Z
i s %04d-%02d-%02d %02d:%02d:%02dZN(
t tR t timet gmtimeR t monR R R R ( R2 R R R R R R5 ( ( R t time2isozM s
%c C sn | d j o t i } n t i | d \ } } } } } } } d t | | t | d | | | | f S( s Return a string representing time in seconds since epoch, t.
If the function is called without an argument, it will use the current
time.
The format of the returned string is like this:
Wed, DD-Mon-YYYY HH:MM:SS GMT
i s" %s %02d-%s-%04d %02d:%02d:%02d GMTi N(
R2 R R3 R4 R R5 R R R R t wdayt DAYSt MONTHS( R2 R R R R R R7 R5 ( ( R t
time2netscape^ s
(t GMTt UTCt UTt Zs ^([-+])?(\d\d?):?(\d\d)?$c C s d } | t j o
d } n t i | } | oo d t | i d } | i d o! | d t | i d } n | i d d j o | } q n | S( Ni i i i i< i t -( R t offsett tzt UTC_ZONESt TIMEZONE_REt searcht mt intt group( RA RE R@ ( ( R t offset_from_tz_stringr s
!c
C s y t i | i d } Wni t j
o] y t | }
Wn t j
o d Sn Xd |
j o
d j n o
|
} q d Sn X| d j o
d } n | d j o
d } n | d j o
d } n t | } t | } t | } t | } t | } | d j o t
i t
i
d } | d } | } | | | } | | } t | d j o) | d j o | d } q| d } qn t | | | | | | | f } | d j oR | d j o
d } n | i } t | } | d j o d Sn | | } n | S( Ni i i i id i2 R< ( t MONTHS_LOWERt indexR5 t lowert
ValueErrorRF t imonR t hrR R t yrt dayR3 t localtimet cur_yrRE t tmpt absR RA R2 t upperRH R@ (
RP R5 RO RN R R RA RS R@ RE RM RR R2 ( ( R t _str2time sR
!
sV ^[SMTWF][a-z][a-z], (\d\d) ([JFMASOND][a-z][a-z]) (\d\d\d\d) (\d\d):(\d\d):(\d\d) GMT$s+ ^(?:Sun|Mon|Tue|Wed|Thu|Fri|Sat)[a-z]*,?\s*s ^
(\d\d?) # day
(?:\s+|[-\/])
(\w+) # month
(?:\s+|[-\/])
(\d+) # year
(?:
(?:\s+|:) # separator before clock
(\d\d?):(\d\d) # hour:min
(?::(\d\d))? # optional seconds
)? # optional clock
\s*
([-+]?\d{2,4}|(?![APap][Mm]\b)[A-Za-z]+)? # timezone
\s*
(?:\(\w+\))? # ASCII representation of timezone in parens.
\s*$c C s; t i | } | o | i } t i | d i d } t
| d | t
| d t
| d t
| d t | d f } t
| Sn | i } t i d | d } d g d \ }
} } } } } } t i | } | d j o% | i \ }
} } } } } } n d St |
| | | | | | S(
s Returns time in seconds since epoch of time represented by a string.
Return value is an integer.
None is returned if the format of str is unrecognized, the time is outside
the representable range, or the timezone string is not recognized. If the
string contains no timezone, UTC is assumed.
The timezone in the string may be numerical (like "-0800" or "+0100") or a
string timezone (like "UTC", "GMT", "BST" or "EST"). Currently, only the
timezone strings equivalent to UTC (zero offset) are known to the function.
The function loosely parses the following formats:
Wed, 09 Feb 1994 22:23:32 GMT -- HTTP format
Tuesday, 08-Feb-94 14:15:29 GMT -- old rfc850 HTTP format
Tuesday, 08-Feb-1994 14:15:29 GMT -- broken rfc850 HTTP format
09 Feb 1994 22:23:32 GMT -- HTTP format (no weekday)
08-Feb-94 14:15:29 GMT -- rfc850 format (no weekday)
08-Feb-1994 14:15:29 GMT -- broken rfc850 format (no weekday)
The parser ignores leading and trailing whitespace. The time may be
absent.
If the year is given with only 2 digits, the function will select the
century that makes the year closest to the current date.
i i i i i i t i N( t STRICT_DATE_RERD t textRE t groupst gRI RJ RK R5 RF t floatR R t lstript
WEEKDAY_REt subR RP RO RN R R RA t LOOSE_HTTP_DATE_RERV ( RY RO RA R[ R R RE RN R5 R RP ( ( R t http2time s J "
%s ^
(\d{4}) # year
[-\/]?
(\d\d?) # numerical month
[-\/]?
(\d\d?) # day
(?:
(?:\s+|[-:Tt]) # separator before clock
(\d\d?):?(\d\d) # hour:min
(?::?(\d\d(?:\.\d*)?))? # optional seconds (and fractional)
)? # optional clock
\s*
([-+]?\d\d?:?(:?\d\d)?
|Z|z)? # timezone (Z is "zero meridian", i.e. GMT)
\s*$c
C s | i } d g d \ } } } } } } } t
i | } | d j o( | i
\ } } } } } } } } n d St | | | | | | | S( sv
As for http2time, but parses the ISO 8601 formats:
1994-02-03 14:15:29 -0100 -- ISO 8601 format
1994-02-03 14:15:29 -- zone is optional
1994-02-03 -- only date
1994-02-03T14:15:29 -- Use T as separator
19940203T141529Z -- ISO 8601 compact format
19940203 -- only date
i N( RY R] R RP R5 RO RN R R RA t ISO_DATE_RERD RE RZ t _RV (
RY RA R RN RE R R5 RO RP Rc ( ( R t iso2time s "
(c C s+ | i d \ } } | i | | i | S( s) Return unmatched part of re.Match object.i N( t matcht spant startt endt string( Re Rg Rh ( ( R t unmatched4 s s ^\s*([^=\s;,]+)s& ^\s*=\s*\"([^\"\\]*(?:\\.[^\"\\]*)*)\"s ^\s*=\s*([^\s;,]*)s \\(.)c
C s t | t j p t g } x| D]} | } g } xo| ogt i | } | o t | } | i d } t i | } | o1 t | } | i d } t i d | } nH t i | } | o+ t | } | i d } | i } n d } | i | | f q< | i i d o2 | i d } | o | i | n g } q< t i d d | \ } } | d j p t d | | | f | } q< W| o | i | q' q' W| S( sm Parse header values into a list of lists containing key,value pairs.
The function knows how to deal with ",", ";" and "=" as well as quoted
values after "=". A list of space separated tokens are parsed as if they
were separated by ";".
If the header_values passed as argument contains multiple values, then they
are treated as if they were a single value separated by comma ",".
This means that this function is useful for parsing header fields that
follow this syntax (BNF as from the HTTP/1.1 specification, but we relax
the requirement for tokens).
headers = #header
header = (token | parameter) *( [";"] (token | parameter))
token = 1*<any CHAR except CTLs or separators>
separators = "(" | ")" | "<" | ">" | "@"
| "," | ";" | ":" | "\" | <">
| "/" | "[" | "]" | "?" | "="
| "{" | "}" | SP | HT
quoted-string = ( <"> *(qdtext | quoted-pair ) <"> )
qdtext = <any TEXT except <">>
quoted-pair = "\" CHAR
parameter = attribute "=" value
attribute = token
value = token | quoted-string
Each header is represented by a list of key/value pairs. The value for a
simple token (not part of a parameter) is None. Syntactically incorrect
headers will not necessarily be parsed as you would want.
This is easier to describe with some examples:
>>> split_header_words(['foo="bar"; port="80,81"; discard, bar=baz'])
[[('foo', 'bar'), ('port', '80,81'), ('discard', None)], [('bar', 'baz')]]
>>> split_header_words(['text/html; charset="iso-8859-1"'])
[[('text/html', None), ('charset', 'iso-8859-1')]]
>>> split_header_words([r'Basic realm="\"foo\bar\""'])
[[('Basic', None), ('realm', '"foobar"')]]
i s \1t ,s ^[=\s;]*RW i s& split_header_words bug: '%s', '%s', %sN( t typet
header_valuest StringTypest AssertionErrort resultRY t orig_textt pairst HEADER_TOKEN_RERD RE Rj RG t namet HEADER_QUOTED_VALUE_REt valuet HEADER_ESCAPE_RER_ t HEADER_VALUE_REt rstripR t appendR] t
startswitht ret subnt non_junkt
nr_junk_chars(
Rm Rr Rt R RY R~ RE Rq Rp Rv ( ( R t split_header_words= sH ,
$ s ([\"\\])c C s g } x | D] } g } xu | D]m \ } } | d j oG t i d | p t i
d | } d | } n d | | f } n | i | q W| o | i d i | q
q
Wd i | S( s Do the inverse (almost) of the conversion done by split_header_words.
Takes a list of lists of (key, value) pairs and produces a single header
value. Attribute values are quoted if needed.
>>> join_header_words([[("text/plain", None), ("charset", "iso-8859/1")]])
'text/plain; charset="iso-8859/1"'
>>> join_header_words([[("text/plain", None)], [("charset", "iso-8859/1")]])
'text/plain, charset="iso-8859/1"'
s ^\w+$s \\\1s "%s"s %s=%ss ; s , N(
t headerst listsRr t attrt kt vR R| RD t HEADER_JOIN_ESCAPE_RER_ Rz t join( R Rr R R R R ( ( R t join_header_words s
c C s d } g } x| D]} g } t }
xBt t i d | D](\ } } | i } | d j o q> n d | j o | d } } n( t i d
| d \ } } | i } | d j o | i } | | j o
| } n | d
j o
t }
n | d j oL | i d o | d } n | i d o | d } n t | } qSn | i | | f q> W| o) |
p | i d n | i | q q W| S( s5 Ad-hoc parser for Netscape protocol cookie-attributes.
The old Netscape cookie format for Set-Cookie can for instance contain
an unquoted "," in the expires field, so we have to use this ad-hoc
parser instead of split_header_words.
XXX This may not make the best possible effort to parse all the crap
that Netscape Cookie headers contain. Ronald Tschalar's HTTPClient
parser is probably better, so could do worse than following that if
this ever gives any trouble.
Currently, this is also used for parsing RFC 2109 cookies.
t expirest domaint patht securet ports max-ages ;\s*RW t =s \s*=\s*i i t versiont "it 0N( s expiress domains paths secures ports max-age( s versionR ( t known_attrsRp t
ns_headerst ns_headerRr t Falset version_sett enumerateR| t splitt iit paramRy R R R R] RK t lct TrueR{ t endswithRa Rz ( R Rr R R R R R R Rp R R ( ( R t parse_ns_headers sD
s \.\d+$c C s[ t i | o t Sn | d j o t Sn | d d j p | d d j o t Sn t S( s* Return True if text is a host domain name.RW i t .iN( t IPV4_RERD RY R R ( RY ( ( R t is_HDN s
"c C s | i } | i } | | j o t Sn t | p t Sn | i | } | d j p
| d j o t Sn | i d p t Sn t | d p t Sn t S( s Return True if domain A domain-matches domain B, according to RFC 2965.
A and B may be host domain names or IP addresses.
RFC 2965, section 1:
Host names can be specified either as an IP address or a HDN string.
Sometimes we compare one host name with another. (Such comparisons SHALL
be case-insensitive.) Host A's name domain-matches host B's if
* their host name strings string-compare equal; or
* A is a HDN string and has the form NB, where N is a non-empty
name string, B has the form .B', and B' is a HDN string. (So,
x.y.com domain-matches .Y.com but not Y.com.)
Note that domain-match is not a commutative operation: a.b.c.com
domain-matches .c.com, but not the reverse.
ii R i N( t ARK t BR R R t rfindt iR{ ( R R R ( ( R t domain_match s
c C s t i | o t Sn t S( sd Return True if text is a sort-of-like a host domain name.
For accepting/blocking domains.
N( R RD RY R R ( RY ( ( R t liberal_is_HDN s c C s | i } | i } t | o
t | p | | j o t Sn t Sn | i d } | o | i | o t Sn | o | | j o t Sn t S( s\ For blocking/accepting domains.
A and B may be host domain names or IP addresses.
R N( R RK R R R R R{ t initial_dotR ( R R R ( ( R t user_domain_match% s
s :\d+$c C sa | i } t i | d } | d j o | i d d } n t i d | d } | i S( s Return request-host, as defined by RFC 2965.
Variation from RFC: returned value is lowercased, for convenient
comparison.
i RW t HostN( t requestt get_full_urlt urlt urlparset hostt
get_headert cut_port_reR_ RK ( R R R ( ( R t request_host: s
c C sO t | } } | i d d j o t i | o | d } n | | f S( sz Return a tuple (request-host, effective request-host name).
As defined by RFC 2965, except both are lowercased.
R is .localN( R R t erhnt req_hostt findR RD ( R R R ( ( R t eff_request_hostJ s
'c C s | i } t i | d \ } } } } | o d | | f } n t | } t i d d | d | | f } | i d p d | } n | S( s$ request-URI, as defined by RFC 2965.i s %s;%sRW t /N( R R R R R t
parameterst queryt fragt escape_patht
urlunparset req_pathR{ ( R R R R R R R ( ( R t request_pathU s !c C sy | i } | i d } | d j oG | | d } y t | Wqu t j
o t d | d Squ Xn t
} | S( Nt :i i s nonnumeric port: '%s'( R t get_hostR R R R RF RL t debugR t DEFAULT_HTTP_PORT( R R R R ( ( R t request_portd s
s %/;:@&=+$,!~*'()s %([0-9a-fA-F][0-9a-fA-F])c C s d | i d i S( Ns %%%si ( Re RG RU ( Re ( ( R t uppercase_escaped_charv s c C sK t | t o | i d } n t i | t } t i t | } | S( sE Escape any invalid characters in HTTP URL, and uppercase all escapes.s utf-8N(
t
isinstanceR t unicodet encodet urllibt quotet HTTP_PATH_SAFEt ESCAPED_CHAR_RER_ R ( R ( ( R R x s c C st | i d } | d j oT | | d } | i d } t | o& | d j p
| d j o d | Sqp n | S( sB Return reach of host h, as defined by RFC 2965, section 1.
The reach R of a host name H is defined as follows:
* If
- H is the host domain name of a host; and,
- H has the form A.B; and
- A has no embedded (that is, interior) dots; and
- B has at least one embedded dot, or B is the string "local".
then the reach of H is .B.
* Otherwise, the reach of H is H.
>>> reach("www.acme.com")
'.acme.com'
>>> reach("acme.com")
'acme.com'
>>> reach("acme.local")
'.local'
R i i t localN( t hR R t bR ( R R R ( ( R t reach s
'c C s8 t | } t | t | i p t Sn t Sd S( s
RFC 2965, section 3.3.6:
An unverifiable transaction is to a third-party host if its request-
host U does not domain-match the reach R of the request-host O in the
origin transaction.
N( R R R R R t get_origin_req_hostR R ( R R ( ( R t is_third_party s
t Cookiec B sS t Z d Z d Z d Z e d Z d Z e d Z d Z d Z
RS( s HTTP Cookie.
This class represents both Netscape and RFC 2965 cookies.
This is deliberately a very simple class. It just holds attributes. It's
possible to construct Cookie instances that don't comply with the cookie
standards. CookieJar.make_cookies is the factory function for Cookie
objects -- it deals with cookie parsing, supplying defaults, and
normalising to the representation used in this class. CookiePolicy is
responsible for checking them to see whether they should be accepted from
and returned to the server.
Note that the port may be present in the headers, but unspecified ("Port"
rather than"Port=80", for example); if this is the case, port is None.
c C s | d j o t | } n | d j o t | } n | d j o | t j o t d n | | _ | | _ | | _
| | _ | | _ | i | _ | | _
| | _ | | _ |
| _ | | _ | | _ |
| _ | | _ | | _ t i | | _ d S( Ns- if port is None, port_specified must be false( R R RF R R t port_specifiedR RL t selfRt Rv R RK t domain_specifiedt domain_initial_dotR t path_specifiedR t discardt commentt comment_urlt copyt restt _rest( R R Rt Rv R R R R R R R R R R R R R ( ( R t __init__ s,
c C s
| | i j S( N( Rt R R ( R Rt ( ( R t has_nonstandard_attr s c C s | i i | | S( N( R R t getRt t default( R Rt R ( ( R t get_nonstandard_attr s c C s | | i | <d S( N( Rv R R Rt ( R Rt Rv ( ( R t set_nonstandard_attr s c C sI | d j o t i } n | i d j o | i | j o t Sn t S( N( t nowR R3 R R R R ( R R ( ( R t
is_expired s
c C s| | i d j o
d } n d | i } | i | | i } | i d j o d | i | i f } n
| i } d | | f S( NRW R s %s=%ss <Cookie %s for %s>(
R R R t pR R t limitRv Rt t namevalue( R R R R ( ( R t __str__ s
c C s g } xg d d d d d d d d d d
d d d
d d g D]2 } t | | } | i d | t | f q: W| i d t | i d d i | S( NR Rt Rv R R R R R R R R R R R R s %s=%ss rest=%ss
Cookie(%s)s , ( t argsRt t getattrR R Rz t reprR R ( R Rt R R ( ( R t __repr__ s 4 !( t __name__t
__module__t __doc__R R R R R R R R ( ( ( R R s '
t CookiePolicyc B s2 t Z d Z d Z d Z d Z d Z RS( s Defines which cookies get accepted from and returned to server.
May also modify cookies, though this is probably a bad idea.
The subclass DefaultCookiePolicy defines the standard rules for Netscape
and RFC 2965 cookies -- override that if you want a customised policy.
c C s
t d S( s Return true if (and only if) cookie should be accepted from server.
Currently, pre-expired cookies never get this far -- the CookieJar
class deletes such cookies itself.
N( t NotImplementedError( R t cookieR ( ( R t set_ok# s c C s
t d S( sA Return true if (and only if) cookie should be returned to server.N( R ( R R R ( ( R t return_ok, s c C s t S( sM Return false if cookies should not be returned, given cookie domain.
N( R ( R R R ( ( R t domain_return_ok0 s c C s t S( sK Return false if cookies should not be returned, given cookie path.
N( R ( R R R ( ( R t path_return_ok5 s ( R R R R R R R ( ( ( R R s
t DefaultCookiePolicyc B s t Z d Z d Z d Z d Z d Z e e BZ e e e e
e
e
e e
e e
e
d Z d Z d Z
d Z d Z d
Z d Z d Z d
Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z! RS( sB Implements the standard rules for accepting and returning cookies.i i i i c C s | | _ | | _ | | _ | | _ | | _ | | _ | | _ |
| _ | | _ | d j o t | | _
n
f | _
| d j o t | } n | | _ d S( sA Constructor arguments should be passed as keyword arguments only.N( t netscapeR t rfc2965t hide_cookie2t
strict_domaint strict_rfc2965_unverifiablet strict_ns_unverifiablet strict_ns_domaint strict_ns_set_initial_dollart strict_ns_set_patht blocked_domainsR t tuplet _blocked_domainst allowed_domainst _allowed_domains( R R R R R R R R R R R R ( ( R R E s
c C s | i S( s4 Return the sequence of blocked domains (as a tuple).N( R R ( R ( ( R R d s c C s t | | _ d S( s$ Set the sequence of blocked domains.N( R R R R ( R R ( ( R t set_blocked_domainsg s c C s0 x) | i D] } t | | o t Sq
q
Wt S( N( R R t blocked_domainR R R R ( R R R ( ( R t
is_blockedk s
c C s | i S( s= Return None, or the sequence of allowed domains (as a tuple).N( R R ( R ( ( R R q s c C s* | d j o t | } n | | _ d S( s- Set the sequence of allowed domains, or None.N( R R R R R ( R R ( ( R t set_allowed_domainst s
c C sH | i d j o t Sn x) | i D] } t | | o t Sq" q" Wt S( N( R R R R t allowed_domainR R R ( R R R ( ( R t is_not_allowedz s
c C ss t d | i | i | i d j p t x? d
D]7 } d | } t | | } | | | p t Sq4 q4 Wt
S( s
If you override .set_ok(), be sure to call this method. If it returns
false, so should your subclass (assuming your subclass wants to be more
strict about which cookies to accept).
s - checking cookie %s=%sR t
verifiabilityRt R R R t set_ok_N( s versionR
s names paths domains port( R R Rt Rv R Ro t nt fn_nameR R t fnR R R ( R R R R R R ( ( R R s
c C s | i d j o t d | i | i t Sn | i d j o | i o t d t Sn. | i d j o | i o t d t Sn t
S( Ns0 Set-Cookie2 without version attribute (%s=%s)i s$ RFC 2965 cookies are switched offs$ Netscape cookies are switched off( R R R R Rt Rv R R R R R ( R R R ( ( R t set_ok_version s
c C sz | i oi t | o\ | i d j o | i o t d t Sqv | i d j o | i o t d t Sqv n t
S( Ni s> third-party RFC 2965 cookie during unverifiable transactions> third-party Netscape cookie during unverifiable transaction( R t is_unverifiableR R R R R R R R R ( R R R ( ( R t set_ok_verifiability s
c C sI | i d j o5 | i o+ | i i d o t d | i t Sn t S( Ni t $s' illegal name (starts with '$'): '%s'( R R R R Rt R{ R R R ( R R R ( ( R t set_ok_name s -c C sw | i oi t | } | i d j p | i d j o | i o/ | i | i o t
d | i | t Sqs n t S( Ni s7 path attribute %s is not a prefix of request path %s(
R R R R R R R R R{ R R R R ( R R R R ( ( R t set_ok_path s
>
c
C s | i | i o t d | i t Sn | i | i o t d | i t Sn | i out | \ } } | i } | i o | i
d d j o | i d } | i d d | } | d j oy | | d } | | d | !} | i d d d d
d d d
d d g j o( t | d j o t d | t SqEqIn | i d o | d } n | } | i d d j } | o" | d j o t d | t Sn | i d j oS | i | o> | i d o- d | i | o t d | | t Sqn | i d j p | i | i @o, t | | p t d | | t Sq\n | i d j p | i | i @oT | t | }
|
i d d j o) t i! | o t d |
| t Sqqn t" S( Ns" domain %s is in user block-lists& domain %s is not in user allow-listR i i i t cot act comt edut orgt nett govt milRF s& country-code second level domain %ss .locals/ non-local domain %s contains no embedded dotsS effective request-host %s (even with added initial dot) does not end end with %ss5 effective request-host %s does not domain-match %ss. host prefix %s for domain %s contains a dot(# R R R R R R R R R R R R R t countR R t jt tldt sldRK t lenR{ t undotted_domainR t
embedded_dotsR R R t DomainRFC2965MatchR t DomainStrictNoDotst host_prefixR RD R (
R R R R R% R R! R R& R# R) R R" ( ( R t
set_ok_domain sV
A
7
!
!'
c C s | i o t | } | d j o
d } n
t | } x| | i i d D]M } y t
| Wn$ t j
o t d | t
Sn X| | j o PqL qL Wt d | | i t
Sn t S( Nt 80Rk s bad port %s (not numeric)s$ request port (%s) not found in %s( R R R R t req_portR t strR R R RF RL R R R ( R R R R R, ( ( R t set_ok_port s$
c C s\ t d | i | i x? d
D]7 } d | } t | | } | | | p t
Sq q Wt S( s
If you override .return_ok(), be sure to call this method. If it
returns false, so should your subclass (assuming your subclass wants to
be more strict about which cookies to return).
s - checking cookie %s=%sR R
R R R R t
return_ok_N( s versions
verifiabilitys secures expiress ports domain( R R Rt Rv R R R R R R R R ( R R R R R R ( ( R R s
c C s^ | i d j o | i o t d t Sn. | i d j o | i o t d t Sn t S( Ni s$ RFC 2965 cookies are switched offs$ Netscape cookies are switched off( R R R R R R R R ( R R R ( ( R t return_ok_version# s
c C sz | i oi t | o\ | i d j o | i o t d t Sqv | i d j o | i o t d t Sqv n t
S( Ni s> third-party RFC 2965 cookie during unverifiable transactions> third-party Netscape cookie during unverifiable transaction( R R R R R R R R R R R ( R R R ( ( R t return_ok_verifiability, s
c C s3 | i o% | i d j o t d t Sn t S( Nt httpss( secure cookie with non-secure request( R R R t get_typeR R R ( R R R ( ( R t return_ok_secure8 s
c C s) | i | i o t d t Sn t S( Ns cookie expired( R R R t _nowR R R ( R R R ( ( R t return_ok_expires> s
c C s{ | i om t | } | d j o
d } n xG | i i d D] } | | j o Pq@ q@ Wt d | | i t Sn t
S( NR+ Rk s0 request port %s does not match cookie port %s( R R R R R, R R R R R R ( R R R R R, ( ( R t return_ok_portD s
c C s t | \ } } | i } | i d j o; | i | i @o* | i
o | | j o t d t Sn | i d j o) t
| | o t d | | t Sn | i d j o- d | i | o t d | | t Sn t S( Ni sQ cookie with unspecified domain does not string-compare equal to request domainsQ effective request-host name %s does not domain-match RFC 2965 cookie domain %sR s; request-host %s does not match Netscape cookie domain %s( R R R R R R R R R t DomainStrictNonDomainR R R R R R ( R R R R R R ( ( R t return_ok_domainR s 9
!
%
c C s t | \ } } | i d p d | } n | i d p d | } n | i | p
| i | p t Sn | i | o t
d | t Sn | i | o t
d | t Sn t S( NR s" domain %s is in user block-lists& domain %s is not in user allow-list(
R R R R R{ R R R R R R R R ( R R R R R ( ( R R h s
c C sE t d | t | } | i | p t d | | t Sn t S( Ns - checking cookie path=%ss %s does not path-match %s( R R R R R R{ R R ( R R R R ( ( R R ~ s
(" R R R R( R8 R' t
DomainLiberalt DomainStrictR R R R R R R R R
R R R R R R R* R. R R0 R1 R4 R6 R7 R9 R R ( ( ( R R ; s:
* 8 c C s& | i } | i t | i | S( N( t adictt keyst sortt mapR ( R< R= ( ( R t vals_sorted_by_key s
c c sx t | } xe | D]] } t } y | i Wn t j
o n# Xt } x t | D]
} | VqS W| p | Vq q Wd S( sB Iterates over nested mapping, depth-first, in sorted order by key.N(
R@ t mappingt valuest objR t itemst AttributeErrorR t
deepvaluest subobj( RA RC RG RB ( ( R RF s
t Absentc B s t Z RS( N( R R ( ( ( R RH s t CookieJarc B s t Z d Z e i d Z e i d Z e i d Z e i d Z e i d Z d Z
e d Z d Z
d Z d
Z d Z d Z d
Z d Z d Z d Z d Z d Z d Z e e e d Z d Z d Z d Z d Z d Z d Z RS( s Collection of HTTP cookies.
You may not need to know about this class: try
urllib2.build_opener(HTTPCookieProcessor).open(url).
s \Ws ([\"\\])s \.?[^.]*s [^.]*s ^\.+s ^\#LWP-Cookies-(\d+\.\d+)c C s? | d j o
t } n | | _ t i | _ h | _ d S( N( t policyR R R t _policyt
_threadingt RLockt
_cookies_lockt _cookies( R RJ ( ( R R s
c C s
| | _ d S( N( RJ R RK ( R RJ ( ( R t
set_policy s c C s g } | i i | | p g Sn t d | | i | } x | i D] } | i i | | p qK n | | } xR | i
D]D } | i i | | p t d q n t d | i | q WqK W| S( Ns! Checking %s for cookies to returns not returning cookies it's a match( t cookiesR RK R R R R RO t cookies_by_pathR= R R t cookies_by_nameRB R R Rz ( R R R RR RS RQ R R ( ( R t _cookies_for_domain s$
c C s= g } x0 | i i D] } | i | i | | q W| S( s2 Return a list of cookies to be returned to server.N( RQ R RO R= R t extendRT R ( R R RQ R ( ( R t _cookies_for_request s c
C s d } | i | t } g } x| D]} | i } | p, t } | d j o | i d | qk n | i
d j o? | i
i | i
o) | d j o | i i d | i
} n
| i
} | i
d j o | i | i n | i d | i | f | d j o | i o | i d | i n | i i d oG | i } | i o | i d o | d } n | i d | n | i d j o6 d
} | i o | d | i } n | i | qq) q) W| S(
s Return a list of cookie-attributes to be returned to server.
like ['foo="bar"; $Path="/"', ...]
The $Version attribute is also added when appropriate (currently only
once per request).
c C s t t | i t | i S( N( t cmpR$ R R t a( RX R ( ( R t decreasing_size s i s $Version=%ss \\\1s %s=%ss
$Path="%s"R i s $Domain="%s"s $Ports ="%s"N( RY RQ R> R R t attrsR R R Rz Rv R R t non_word_reRD t quote_reR_ Rt R R R R{ R R R R (
R RQ RY Rv R R R RZ R R ( ( R t
_cookie_attrs s@
3
c C s5 t d | i i t t i | i _ | _ t | \ } } | i i | i i
@} | i | } | i | } | o1 | i d p | i d d i | q n | i i oY | i i oK | i d o: x7 | D]+ } | i d j o | i d d Pq q Wn | i i | i d S( s Add correct Cookie: header to request (urllib2.Request object).
The Cookie2 header is also added unless policy.hide_cookie2 is true.
t add_cookie_headerR s ; t Cookie2i s $Version="1"N( R R RN t acquireRF R3 RK R5 R R R R R R8 t strict_non_domainRV RQ R] RZ t
has_headert add_unredirected_headerR R R R R t releaset clear_expired_cookies( R R RQ R R Ra R RZ ( ( R R^ s&
!,
c C sD g } d } d } x+| D]#} | d \ } } t } t } h } h } x| d D]\ }
}
|
i } | | j p
| | j o
| }
n |
| j o |
d j o
t }
n |
| j o qR n |
d j o2 |
d j o t d
t } Pn |
i }
n |
d j o0 | o qR n |
d j o t d qR qBn |
d j oT t } y t |
}
Wn$ t j
o t d t } Pn Xd }
| i |
}
n |
| j p
|
| j oJ |
d j o/ |
d d d
g j o t d |
t } Pn |
| |
<qR |
| |
<qR W| o q n | i | | | | f q W| S( s Return list of tuples containing normalised cookie information.
attrs_set is the list of lists of key,value pairs extracted from
the Set-Cookie or Set-Cookie2 headers.
Tuples are name, value, standard, rest, where name and value are the
cookie name and value, standard is a dictionary containing the standard
cookie-attributes (discard, secure, version, expires or max-age,
domain, path and port) and rest is a dictionary containing the rest of
the cookie-attributes.
R R R R s max-ageR R R R t
commenturli i s% missing value for domain attributesM missing or invalid value for expires attribute: treating as session cookies? missing or invalid (non-numeric) value for max-age attributes! missing value for %s attributeN( s discards secure( s versions expiress max-ages domains paths ports commentRf ( t
cookie_tuplest
boolean_attrst value_attrst attrs_sett cookie_attrsRt Rv R t max_age_sett
bad_cookiet standardR R R RK R R R R RF RL R R5 Rz ( R Rj Rg Rk R Rv Rn Ri Rl R R Rh Rm R Rt ( ( R t _normalized_cookie_tuples4 sj
# c C s | \ } } } } | i d t } | i d t } | i d t } | i d t }
| i d d }
|
d j o t
|
}
n | i d t } | i d t } | i d d } | i d d } | t j o# | d
j o t } t | } ny t } t | } | i d } | d j o- |
d
j o | | } q\| | d } n t | d
j o
d } n | t j } t } | o t | i d } n | t j o t | \ } } | } n | i d p d | } n t } | t j o< | d j o t# | } qGt } t$ i% d d
| } n d } |
t j o d }
t } nY |
| i' j oH y | i( | | | Wn t) j
o n Xt* d | | | d Sn t+ |
| | | | | | | | | | |
| | | | S( NR R R R R R R R Rf RW R ii i R s \s+s2 Expiring cookie, domain='%s', path='%s', name='%s'(, t tupRt Rv Rn R R RH R R R R R R RF R R R R R R R R R R R R R$ R R t boolR{ R R R R R R| R_ R R5 t cleart KeyErrorR R ( R Rp R R R R R R R R R R R R Rn R R R Rt R Rv R R ( ( R t _cookie_from_cookie_tuple s|
c C sT | i | } g } x8 | D]0 } | i | | } | o | i | q q W| S( N(
R Ro Rj Rg RQ Rp Rt R R Rz ( R Rj R RQ Rg Rp R ( ( R t _cookies_from_attrs_set s c
C sw | i } | i d } | i d } | i i } | i i } | o | p0 | o | p | o | p | o | o g Sn y | i
t | | } Wn t g } n X| o | o y | i
t | | } Wn t g } n X| oR h } x* | D]" } d | | i | i | i f <qW| d }
t |
| } n | o | i | qsn | S( sA Return sequence of Cookie objects extracted from response object.s Set-Cookie2s
Set-Cookiec C s" | i | i | i f } | | j S( N( t ns_cookieR R Rt t keyt lookup( Rv Rx Rw ( ( R t no_matching_rfc2965 s N( t responset infoR t
getheaderst rfc2965_hdrst ns_hdrsR RK R R Ru R R RQ R R t
ns_cookiesRx R R R R Rt Ry t filterRU (
R Rz R RQ R R} R R R Rx Ry R R~ ( ( R t make_cookies s: @
c C sd | i i t t i | i _ | _ | i i | | o | i
| n | i i d S( s- Set a cookie if policy says it's OK to do so.N( R RN R` RF R3 RK R5 R R R t
set_cookieRd ( R R R ( ( R t set_cookie_if_ok* s
c C s | i } | i i zm | i | j o h | | i <n | | i } | i | j o h | | i <n | | i } | | | i
<Wd | i i Xd S( s? Set a cookie, without checking whether or not it should be set.N( R RO t cRN R` R R t c2R t c3Rt Rd ( R R R R R ( ( R R 4 s
c C s t d | i | i i t t i | i _ | _ xN | i
| | D]: } | i i
| | o t d | | i | qR qR W| i i d S( sA Extract cookies from response, where allowable given the request.s extract_cookies: %ss setting cookie: %sN( R Rz R{ R RN R` RF R3 RK R5 R R R R R Rd ( R Rz R R ( ( R t extract_cookiesA s
c C s | d j o@ | d j p
| d j o t d n | i | | | =na | d j o/ | d j o t d n | i | | =n% | d j o | i | =n
h | _ d S( s Clear some cookies.
Invoking this method without arguments will clear all cookies. If
given a single argument, only cookies belonging to that domain will be
removed. If given two arguments, cookies belonging to the specified
path within that domain are removed. If given three arguments, then
the cookie with the specified name, path and domain is removed.
Raises KeyError if no matching cookie exists.
s8 domain and path must be given to remove a cookie by names. domain must be given to remove cookies by pathN( Rt R R R RL R RO ( R R R Rt ( ( R Rr M s
c C sY | i i x8 | D]0 } | i o | i | i | i | i q q W| i i d S( s Discard all session cookies.
Note that the .save() method won't save session cookies anyway, unless
you ask otherwise by passing a true ignore_discard argument.
N(
R RN R` R R Rr R R Rt Rd ( R R ( ( R t clear_session_cookiesh s
$c C sk | i i t i } x> | D]6 } | i | o | i | i | i | i
q q W| i i d S( s Discard all expired cookies.
You probably don't need to call this method: expired cookies are never
sent back to the server (provided you're using DefaultCookiePolicy),
this method is called by CookieJar itself every so often, and the
.save() method won't save expired cookies anyway (unless you ask
otherwise by passing a true ignore_expires argument).
N( R RN R` R3 R R R Rr R R Rt Rd ( R R R ( ( R Re u s
$c C s
t | i S( N( RF R RO ( R ( ( R t __iter__ s c C s% d } x | D] } | d } q
W| S( s# Return number of contained cookies.i i N( R R R ( R R R ( ( R t __len__ s c C sD g } x! | D] } | i t | q
Wd | i d i | f S( Ns <%s[%s]>s , ( t rR R Rz R t __class__R ( R R R ( ( R R s
c C sD g } x! | D] } | i t | q
Wd | i d i | f S( Ns <%s[%s]>s , ( R R R Rz R- R R ( R R R ( ( R R s
( R R R R| t compileR[ R\ t strict_domain_ret domain_ret dots_ret magic_reR R RP RT RV R] R^ Ro Rt Ru R R R R Rr R Re R R R R ( ( ( R RI s6 < # a X 4
t LoadErrorc B s t Z RS( N( R R ( ( ( R R s t
FileCookieJarc B sV t Z d Z e e e d Z e e e d Z e e e d Z e e e d Z RS( s6 CookieJar that can be loaded from and saved to a file.c C s_ t i | | | d j o& y | d WqC t d qC Xn | | _ t | | _ d S( s}
Cookies are NOT loaded from the named file until either the .load() or
.revert() method is called.
RW s filename must be string-likeN( RI R R RJ t filenameR RL Rq t delayload( R R R RJ ( ( R R s
c C s
t d S( s Save cookies to a file.N( R ( R R t ignore_discardt ignore_expires( ( R t save s c C sr | d j o- | i d j o
| i } q: t t n t | } z | i | | | | Wd | i
Xd S( s Load cookies from a file.N( R R R RL t MISSING_FILENAME_TEXTt openR
t _really_loadR R t close( R R R R R
( ( R t load s
c C s | d j o- | i d j o
| i } q: t t n | i i t i | i } h | _ y | i | | | Wn% t t f j
o | | _ n X| i i d S( s Clear all cookies and reload cookies from a saved file.
Raises LoadError (or IOError) if reversion is not successful; the
object's state will not be altered if this happens.
N( R R R RL R RN R` R t deepcopyRO t old_stateR R R R t IOErrorRd ( R R R R R ( ( R t revert s
( R R R R R R R R R ( ( ( R R s
( s LWPCookieJars lwp_cookie_str( s MozillaCookieJar(X R R R| R R R3 R t loggingt typesRn t threadingRL t ImportErrort dummy_threadingt httplibt calendarR t getLoggerR R- t HTTP_PORTR R R R R R8 R9 RI R Rz RK R R6 R: RB R RC RH RV RX t IR^ t XR` Ra Rb Rd Rj Rs Ru Rx Rw R R R R R R R R R R R R R R R R R R R R R R R R@ RF RH RI R R R t
_LWPCookieJart LWPCookieJart lwp_cookie_strt _MozillaCookieJart MozillaCookieJar(F R R R R R R R@ R R R R Rj R6 Rb R R R R R Ru R Rd R R R R R R R| R: RV R Rn RB R Rx R R Rs RH RI R R R R RC R RI RF R R Rw R R R R RL R9 Ra R8 RH R R^ R R3 R R R RX R` ( ( R t ? s ?
* * 5 8 ! U 8 '
# ^! M :