3

H��X��,@s�
dZd
dl
mZ
d
dlZd
dlmZ
eddddd	d
ddd
ddddddddddddddddddd d!d"d#d$d%d&d'd(d)d*d+d,d-d.d/g+ed0d1�Zd2d3d4d5d6d7�Z	ej
d8ej�Zej
d9ej�Z
ej
d:�
Zej
d;ej�Zej
d<�
Zej
d=ej�
Zej
d>�
Zed?d@�Zdej
dAej�fdej
dB�
fdCej
dD�
fdEej
dFejejB�fdGe
fdHefdIej
dJej�fdKej
dLej�fdMej
dNdjeeje��
�
fdOej
dPej�fdQej
dRejejB�fgZdSdT�ZdUdV�ZdWdX�Zd[dYdZ�
ZdS)\z�
    babel.messages.jslexer
    ~~~~~~~~~~~~~~~~~~~~~~

    A simple JavaScript 1.5 lexer which is used for the JavaScript
    extractor.

    :copyright: (c) 2013 by the Babel Team.
    :license: BSD, see LICENSE for more details.
�)
�
namedtupleN)
�unichr�
+�
-�
*�
%z!=z==�
<�
>z<=z>=�
=z+=z-=z*=z%=z<<z>>z>>>z<<=z>>=z>>>=�
&z&=�
|z|=z&&z||�
^z^=�
(�
)�
[�
]�
{�
}�
!z--z++�
~�
,�
;�
.�
:T)�key�reverse�
�
�

�

�
	)�
b�
f�
n�
r�
tz[\w$_][\w\d$_]*z[\w$_][\w\d$_.]*[\w\d$_.]z/=?z%/(?:[^/\\]*(?:\\.[^/\\]*)*)/[a-zA-Z]*z(\r\n|\n|\r)z\\z[a-fA-F0-9]{1,4}�Tokenztype value linenoz\s+z<!--.*Zlinecommentz//.*Zmultilinecommentz	/\*.*?\*/�dotted_name�name�numberzb(
        (?:0|[1-9]\d*)
        (\.\d+)?
        ([eE][-+]?\d+)? |
        (0x[a-fA-F0-9]+)
    )Zjsx_tagz(?:</?[^>\s]+|/>)�operatorz(%s)�template_stringz`(?:[^`\\]*(?:\\.[^`\\]*)*)`�stringzT(
        '(?:[^'\\]*(?:\\.[^'\\]*)*)'  |
        "(?:[^"\\]*(?:\\.[^"\\]*)*)"
    )cCs^g}xTtD]L\}}|r&|r&d
|kr&q
|r6|dkr6q
|dkrH|
sDq
d}|j
||f�

q
W|S)ze
    Get a tokenization rule list given the passed syntax options.

    Internal to this module.
    �jsxr+r'r()�_rules�append)r-�dottedr+�rules�
token_type�rule�r4�/usr/lib/python3.6/jslexer.py�	get_rules:s










r6c

Cs|jd
kr|j
dkS|jdkS)
zzA helper function that helps the tokenizer to decide if the current
    token may be followed by a division operator.
    r*rrr�++�--r(r)r,�regexp)rrrr7r8)r(r)r,r9)�type�value)
�tokenr4r4r5�indicates_divisionNs



r=c
Cs4
tj
d
|dd��}g}
|
j}d}x�|jd|�}|dkr:P||||��

||d}|tkrl|t|�

n�|dkr�tj||d�}|dk	r�|j�}t|�
dkr�y|t	t
|d	��
�

Wntk
r�


YnX|d
}q$|||�

|j�}q$n||�

n||�

|d}q$W|t|�
k�
r*|||d��

dj
|
�
S)
z�Unquote a string with JavaScript rules.  The string has to start with
    string delimiters (``'``, ``"`` or the back-tick/grave accent (for template strings).)
    z\1�
r
�
\ZuU�N�������)�line_join_re�subr/�find�escapes�
uni_escape_re�match�group�lenr�int�
ValueError�end�join)r,�result�add�posZ
escape_posZ	next_charZescapedZ
escaped_valuer4r4r5�unquote_stringWs@






















rUccs�d
}d}d}t|�
}t
|
||d�}x�||kr�x^|D]\}	}
|
j||�}|dk	r2Pq2W|rjtj||�}d}	ntj||�}d}	|dkr�|d7}q$|j�}|	dk	r�t|	||�}
t|
�
}|
V
|ttj	|�
�
7}|j
�}q$WdS)z�
    Tokenize JavaScript/JSX source.  Returns a generator of tokens.

    :param jsx: Enable (limited) JSX parsing.
    :param dotted: Read dotted names as single name token.
    :param template_string: Support ES6 template strings
    Fr
r>)r-r0r+Nr*r9)rMr6rK�division_re�regex_rerLr&r=�line_re�findallrP)�sourcer-r0r+Z
may_dividerT�linenorPr1r2r3rKZtoken_valuer<r4r4r5�tokenize�s2


















r\)TTT) �__doc__�collectionsr�reZ
babel._compatr�sortedrMZ	operatorsrI�compile�UNICODEZname_reZdotted_name_rerV�DOTALLrWrX�patternrFrJr&�VERBOSE�
IrQ�map�escaper.r6r=rUr\r4r4r4r5�<module>sF





























	8