Skip to content

Commit 35e19fc

Browse files
committed
Simplify the exact token type description
1 parent 94140f1 commit 35e19fc

1 file changed

Lines changed: 3 additions & 4 deletions

File tree

‎Doc/library/tokenize.rst‎

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33

44
.. module:: tokenize
55
:synopsis: Lexical scanner for Python source code.
6-
`
6+
77
**Source code:** :source:`Lib/tokenize.py`
88

99
--------------
@@ -15,9 +15,8 @@ colorizers for on-screen displays.
1515

1616
To simplify token stream handling, all :ref:`operator <operators>` and
1717
:ref:`delimiter <delimiters>` tokens and :data:`Ellipsis` are returned using
18-
the generic :data:`~token.OP` token type. The exact
19-
type can be determined by checking the :attr:`TokenInfo.exact_type` property on
20-
the :class:`TokenInfo` returned from :func:`tokenize.tokenize`.
18+
the generic :data:`~token.OP` token type.
19+
The :attr:`TokenInfo.exact_type` property gives the exact token type.
2120

2221

2322
.. warning::

0 commit comments

Comments
 (0)