gh-102856: Clean some of the PEP 701 tokenizer implementation#103634

Merged

pablogsal merged 2 commits intopython:mainfrom pablogsal:bpo-102856-3

Apr 19, 2023

+67-74

Commits on Apr 19, 2023

pythongh-102856 : Clean some of the PEP 701 tokenizer implementation
pablogsal
committed
fixup! pythongh-102856 : Clean some of the PEP 701 tokenizer implementation
pablogsal
committed