Plenty of code relies on local regexes to find tokens. All of these are half-backed. We need a common `next-token` functionality as a building block for many more advanced parts. Reference: #648, #628, #572, #549, #450, #229. Possibly many more.
Plenty of code relies on local regexes to find tokens. All of these are half-backed.
We need a common
next-tokenfunctionality as a building block for many more advanced parts.Reference: #648, #628, #572, #549, #450, #229. Possibly many more.