aboutsummaryrefslogtreecommitdiff
path: root/Parser/tokenizer.c
AgeCommit message (Expand)Author
2022-02-08bpo-46541: Replace core use of _Py_IDENTIFIER() with statically initialized g...Eric Snow
2022-02-08bpo-46521: Fix codeop to use a new partial-input mode of the parser (GH-31010)Pablo Galindo Salgado
2022-02-01bpo-14916: use specified tokenizer fd for file input (GH-31006)Paul m. p. P
2022-01-25bpo-46091: Correctly calculate indentation levels for whitespace lines with c...Pablo Galindo Salgado
2021-12-12bpo-45855: Replaced deprecated `PyImport_ImportModuleNoBlock` with PyImport_I...Kumar Aditya
2021-12-12bpo-46054: Fix parsing error when parsing non-utf8 characters in source files...Pablo Galindo Salgado
2021-11-21Ensure the str member of the tokenizer is always initialised (GH-29681)Pablo Galindo Salgado
2021-11-20bpo-45811: Improve error message when source code contains invisible control ...Pablo Galindo Salgado
2021-11-14bpo-45738: Fix computation of error location for invalid continuation (GH-29550)Pablo Galindo Salgado
2021-10-28bpo-45562: Ensure all tokenizer debug messages are printed to stderr (GH-29270)Pablo Galindo Salgado
2021-10-27bpo-45562: Print tokenizer debug messages to stderr (GH-29250)Pablo Galindo Salgado
2021-10-22bpo-45574: fix warning about `print_escape` being unused (GH-29172)Nikita Sobolev
2021-10-22bpo-45562: Only show debug output from the parser in debug builds (GH-29140)Pablo Galindo Salgado
2021-10-13bpo-45434: Mark the PyTokenizer C API as private (GH-28924)Victor Stinner
2021-10-12bpo-45439: Move _PyObject_CallNoArgs() to pycore_call.h (GH-28895)Victor Stinner
2021-10-12bpo-45439: Rename _PyObject_CallNoArg() to _PyObject_CallNoArgs() (GH-28891)Victor Stinner
2021-07-30Update URLs in comments and metadata to use HTTPS (GH-27458)Noah Kantrowitz
2021-07-10bpo-44317: Improve tokenizer errors with more informative locations (GH-26555)Pablo Galindo Salgado
2021-06-12Fix typos in multiple files (GH-26689)Binbin
2021-06-12bpo-44396: Update multi-line-start location when reallocating tokenizer buffe...Pablo Galindo
2021-06-08bpo-43833: Emit warnings for numeric literals followed by keyword (GH-25466)Serhiy Storchaka
2021-05-22bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298)Pablo Galindo
2021-03-30Fix tokenizer error when raw decoding null bytes (GH-25080)Pablo Galindo
2021-03-28bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)Pablo Galindo
2021-03-14bpo-43410: Fix crash in the parser when producing syntax errors when reading ...Pablo Galindo
2021-01-20bpo-40176: Improve error messages for unclosed string literals (GH-19346)Batuhan Taskaya
2021-01-20bpo-42864: Fix compiler warning in the tokenizer with the new paren stack for...Pablo Galindo
2021-01-19bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)Pablo Galindo
2021-01-14bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)Lysandros Nikolaou
2020-12-01bpo-42519: Replace PyMem_MALLOC() with PyMem_Malloc() (GH-23586)Victor Stinner
2020-06-15bpo-36020: Remove snprintf macro in pyerrors.h (GH-20889)Victor Stinner
2020-06-11bpo-40847: Consider a line with only a LINECONT a blank line (GH-20769)Lysandros Nikolaou
2020-05-26Fix peg_generator compiler warnings under MSVC (GH-20405)Ammar Askar
2020-05-12bpo-40593: Improve syntax errors for invalid characters in source code. (GH-2...Serhiy Storchaka
2020-05-04bpo-40246: Revert reporting of invalid string prefixes (GH-19888)Lysandros Nikolaou
2020-04-21bpo-40335: Correctly handle multi-line strings in tokenize error scenarios (G...Pablo Galindo
2020-04-12bpo-40246: Report a better error message for invalid string prefixes (GH-19476)Lysandros Nikolaou
2020-03-25bpo-39882: Add _Py_FatalErrorFormat() function (GH-19157)Victor Stinner
2020-03-07bpo-39882: Py_FatalError() logs the function name (GH-18819)Victor Stinner
2020-02-27closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)Andy Lester
2020-02-12bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)Serhiy Storchaka
2020-02-11bpo-39500: Document PyUnicode_IsIdentifier() function (GH-18397)Victor Stinner
2020-01-06bpo-39209: Manage correctly multi-line tokens in interactive mode (GH-17860)Pablo Galindo
2019-12-08bpo-38673: dont switch to ps2 if the line starts with comment or whitespace (...Batuhan Taşkaya
2019-08-15Indent code inside if block. (GH-15284)Hansraj Das
2019-07-29Fix `SyntaxError` indicator printing too many spaces for multi-line strings (...Anthony Sottile
2019-05-22bpo-36878: Only allow text after `# type: ignore` if first character ASCII (G...Michael J. Sullivan
2019-05-22bpo-36878: Track extra text added to 'type: ignore' in the AST (GH-13479)Michael J. Sullivan
2019-05-18bpo-2180: Treat line continuation at EOF as a `SyntaxError` (GH-13401)Anthony Sottile
2019-05-11bpo-36878: Allow extra text after `# type: ignore` comments (GH-13238)Michael J. Sullivan