parser: fix CRLF(\r\n) file parsing error, SyntaxError: 'invalid syntax'

[wetor]

The python file on the Windows platform may be in CRLF format. For example, git may convert the file to CRLF under Windows, resulting in parsing failure

[ncw]

The fix looks reasonable to me.

Can you link some docs showing .py files can end CR LF please?

[codecov]

Codecov Report

Patch coverage: 100.00% and no project coverage change.

Comparison is base (337df2a) 74.41% compared to head (42f20b7) 74.42%.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #219   +/-   ##
=======================================
  Coverage   74.41%   74.42%           
=======================================
  Files          76       76           
  Lines       12673    12675    +2     
=======================================
+ Hits         9431     9433    +2     
  Misses       2567     2567           
  Partials      675      675           

Impacted Files	Coverage Δ
parser/lexer.go	89.07% <100.00%> (+0.04%)	⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

[wetor]

here https://docs.python.org/3.5/reference/lexical_analysis.html
of course, we can also use "build tag" to do special processing on the Windows platform

[ncw]

The docs you linked are quite clear

A physical line is a sequence of characters terminated by an end-of-line sequence. In source files, any of the standard platform line termination sequences can be used - the Unix form using ASCII LF (linefeed), the Windows form using the ASCII sequence CR LF (return followed by linefeed), or the old Macintosh form using the ASCII CR (return) character. All of these forms can be used equally, regardless of platform.

So this should be done on any platform, so we don't need build tags.

Also, theoretically, we should be looking at CR terminated lines. However that is a bigger change to the lexer, so let's not do that until someone requests it as I don't think macs have used CR terminated files for a very long time.

I'll merge this now - thank you :-)