optional-comment-based highlighter (re, %, fmt, tmp) added, closes #19;

format string highlight added (except datetime and escape support), closes #36;
template string highlight added;
pure raw string support added;
space between pound sign and comment text added, closes #32, closes #33;
3.5 matrix multiplication operator added;
3.6 async, await keywords added;
3.6 await, aenter, aexit, aiter and anext dunder methods support added;
3.6 StopAsyncIteration exception added;
3.7 f-string support added;
improved and updated README + screenshot

Author: petervaro

README.md

@@ -1,74 +1,24 @@
 Python and Cython language bundles
 ==================================
 
-***THE MOST POPULAR (AND FEATURE RICH) PYTHON SYNTAX HIGHLIGHTER FOR SUBLIME
-([OVER 11,000 DOWNLOADS!](https://sublime.wbond.net/packages/Python%203))***
+***THE MOST POPULAR AND MOST FEATURE RICH PYTHON SYNTAX HIGHLIGHTER FOR
+SUBLIME TEXT AS OF TIME,
+[OVER 75,000 DOWNLOADS](https://sublime.wbond.net/packages/Python%203))!***
 
-This repo is about python 3.3+ and cython 0.19.1+ related bundles for Sublime
-Text 2/3 and TextMate editors and for online usage.
+Bleeding-egde Python and Cython syntax highlighters and other goodies for
+Sublime Text 2/3 and TextMate editors.
 
-![Preview](img/preview.png)
-
-Python 3.3
-----------
-
-Python 3.3 is a truly powerful version of python, with a lot new and creative
-features -- and some of them are actually bringing new or different syntaxes!
-Unfortunately, the only available and default `tmLanguage` syntax-highlight
-definition file is pretty old (only supports 2.x) and has several annoying bugs
-and unfinished features -- not to mention, that the syntax of the new python
-features brake the full highlighting of the entire code.
-
-I belive, that a good syntax highlighter for software developers has to be as
-much help as the auto-completion pop-up or a code linter script in a text
-editor.
-
-That's why I have implemented a new syntax definition from scratch that is
-created especially for python 3.3 and above. I did this with pure python
-structures, some converters and build scripts. *(I found editing `JSON` files
-with their ugly double escape characters or editing `XML`/`tmLanguage`s directly
-could be pretty annoying on the long run.)*
-
-The end result is very flexible, dynamic, reuseable and easy to read and write
-(syntax highlighted regexes -- with comments and variables). It is also simple
-to maintain and pretty short too (the new version is only 35% of the old one)!
-
-Cython support
---------------
-
-Unfortunately cython syntax highlighter definitions also lack of updated,
-fully-working and 100% python compatible syntax definitions! I have created a
-brand-new build-system to combine and convert the highlighter based on the
-python one. With this tool, it is quite easy to keep up-to-date both the cython
-and the python definitions, and as a plus, I only have to maintain a single
-code-base. *Viva la* modularity!
-
-Highlight on web
-----------------
+*(Or for any other editor, that is using the `.tmLanguage` syntax definition)*
 
-***WORK IN PROGRESS***
-
-Previously I wanted to support [`Rainbow.js`](http://craig.is/making/rainbows),
-but unfortunately this project hasn't been updated for almost a year now, it
-also has several very important, pending, open issues and without these the
-proper "translation" from my syntax highlighters to a Rainbow one is impossible.
+![Preview](img/preview.png)
 
-Thankfully, there is a new, and very actively developed tool, called the
-[Ace Editor](http://ace.c9.io). I'm willing to support them, as they are
-providing a more feature rich syntax highlighter system, they call it
-`Ace Mode`. *(Further more, it is very similar to the `tmLanguage` system, and
-they also provide a tool for automatic `Mode` generation from `tmLanguage`,
-which is not perfect of course, as they claimed, but still better than
-nothing!)*
 
-> The old, Rainbow-compatible version is still available:
-`etc/archive/js/Python.js`, but as before, it is still work-in-progress state,
-and it is very unlikely that I will finish it and/or support it in the future.
 
-New is better
--------------
+State of the Art
+----------------
 
-Below are some of the most important improvements:
+Below are some of the most important improvements compared to the existing
+syntax highlighters:
 
 - Added better number highlighting:
 	- All types of floating point notations are working now;
@@ -79,21 +29,32 @@ Below are some of the most important improvements:
 - Declaration rules are extended with `nonlocal`.
 - *Ex-statements-now-functions* (like `print`) are updated.
 - New Exception highlighting added.
+- New keywords `async` and `await` added.
 - Function annotations are now supported.
 - Conventional-language variable `cls` added.
-- Better regex support (multiline, grouping, comments and more are improved).
+- Optional-comment-based string highlighting:
+    - Better regex support (multiline, grouping, comments and more are improved).
+    - Format specifier mini-language
+    - Template strings
+- Matrix multiplication operator
 - String and byte literals:
 	- Byte notation added;
 	- Proper string prefixes added.
 - All the unused built-in and magic functions/methods are now removed.
 - All the unused keywords and notations are now removed.
 
+
+
 Future plans
 ------------
 
-- Support format mini-language in strings.
+- Combine optional-comment-based string highlighters, eg. `# syntax:re+fmt`
+- Add optional-comment-based external language support, eg: `# syntax:sql`, for
+  starters these should be SQL, HTML and JSON
 - Create a better Twilight-based theme file.
 
+
+
 Installation
 ------------
 
@@ -129,6 +90,8 @@ repository. Navigate to your `Packages` folder and create a `Python3` and/or a
 folder and copy `Gloom.tmTheme` into it. Then go to user-settings, and change
 your old color theme to the new one.*
 
+
+
 Contribute
 ----------
 
@@ -144,24 +107,31 @@ please use the following conventions when editing the original python files:
 - comment separators can be easily generated with the `src.utils.separator()`
 function
 
+
+
 Appreciation
 ------------
 
-*Thank you very much @joncle (Jon Clements) for all the support and answers
-about python and regexes in general, @kms70847 (Kevin), @Ffisegydd (Keiron
-Pizzey), @schesis (Zero Piraeus) and @poke (Patrick Westerhoff) for the
-feedbacks, and of course thanks for all the wonderful members of the
-[sopython](http://sopython.com) chat room for supporting me in any ways! May the
-Cabbage be with us ;)*
+Thank you very much [@joncle](https://github.com/joncle) (Jon Clements) for all
+the support in general, [@kms70847](https://github.com/kms70847) (Kevin),
+[@Ffisegydd](https://github.com/Ffisegydd) (Keiron Pizzey),
+[@schesis](https://github.com/schesis) (Zero Piraeus) and
+[@poke](https://github.com/poke) (Patrick Westerhoff) for the feedbacks, and of
+course thanks for all the wonderful members of the
+[sopython](http://sopython.com) chat room for supporting me in any ways! *May
+the Cabbage be with us ;)*
+
+I also want to thank for all the loyal users of this package, and especially
+[@rahul-ramadas](https://github.com/rahul-ramadas) (Rahul Ramadas) and
+[@bordaigorl](https://github.com/bordaigorl) (Emanuele D'Osualdo) who were
+very active on giving me feedbacks, reports, etc.
+
 
-*I also want to thank for all the loyal users of this package, and especially
-@rahul-ramadas (Rahul Ramadas) and @bordaigorl (Emanuele D'Osualdo) who were
-very active on giving me feedbacks, reports, etc.*
 
-LICENSE
+License
 -------
 
-Copyright (C) 2013 - 2014 Peter Varo
+Copyright (C) 2013 - 2017 Peter Varo
 
 This program is free software: you can redistribute it and/or modify it under
 the terms of the GNU General Public License as published by the Free Software

TODO

@@ -1,131 +0,0 @@
-## INFO ########################################################################
-##                                                                            ##
-##                   Python and Cython Syntax Highlighters                    ##
-##                   =====================================                    ##
-##                                                                            ##
-##                       Version: 2.0.00.085 (20141101)                       ##
-##                                 File: TODO                                 ##
-##                                                                            ##
-##            For more information about the project, please visit            ##
-##                   <https://github.com/petervaro/python>.                   ##
-##                    Copyright (C) 2013 - 2014 Peter Varo                    ##
-##                                                                            ##
-##  This program is free software: you can redistribute it and/or modify it   ##
-##   under the terms of the GNU General Public License as published by the    ##
-##       Free Software Foundation, either version 3 of the License, or        ##
-##                    (at your option) any later version.                     ##
-##                                                                            ##
-##    This program is distributed in the hope that it will be useful, but     ##
-##         WITHOUT ANY WARRANTY; without even the implied warranty of         ##
-##            MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.            ##
-##            See the GNU General Public License for more details.            ##
-##                                                                            ##
-##     You should have received a copy of the GNU General Public License      ##
-##     along with this program, most likely a file in the root directory,     ##
-##        called 'LICENSE'. If not, see <http://www.gnu.org/licenses>.        ##
-##                                                                            ##
-######################################################################## INFO ##
-
-#---------------------------- 11 POSTS IN 4 FILES -----------------------------#
-TODO:
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 1
-  - file: etc/archive/to_css.py
-    line: 1
-    note: |
-          Add this functionality src.convert.Theme
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 2
-  - file: etc/archive/to_css.py
-    line: 5
-    note: |
-          decide if we need `word-wrap: break-word;` or not?
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 3
-  - file: src/cython.py
-    line: 138
-    note: |
-          highlight type declarations in functions!
-          Function name
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 4
-  - file: src/cython.py
-    line: 155
-    note: |
-          add illegal
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 5
-  - file: src/cython.py
-    line: 227
-    note: |
-          rearrange -> what is builtin function and what is builtin type?
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 6
-  - file: src/cython.py
-    line: 287
-    note: |
-          rearrange -> what is magic function and what is magic variable?
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 7
-  - file: src/python.py
-    line: 135
-    note: |
-          add illegal
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 8
-  - file: src/python.py
-    line: 198
-    note: |
-          rearrange -> what is builtin function and what is builtin type?
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 9
-  - file: src/python.py
-    line: 246
-    note: |
-          rearrange -> what is magic function and what is magic variable?
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 10
-  - file: src/common.py
-    line: 584
-    note: |
-          rearrange -> what is magic function and what is magic variable?
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 11
-  - file: src/common.py
-    line: 614
-    note: |
-          decide if source.sql and special words, like SELECT and INSERT needed
-
-
-
-#----------------------------- 2 POSTS IN 2 FILES -----------------------------#
-NOTE:
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 1
-  - file: src/common.py
-    line: 862
-    note: |
-          the problem of making this to be a begin/end block
-          is that the patterns needs to include the multiline-
-          comments only if the expression is in multline
-          quotes otherwise it should be exclude it...
-
-  #- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - #
-  # 2
-  - file: build.py
-    line: 93
-    note: |
-          Old path to theme files => DO NOT SUPPORT IT:
-          '~/Library/Application Support/Sublime Text 3/Packages/Color Scheme - Default'
-
-

VERSION

@@ -1 +1 @@
-2.0.00.085 (20141101)
+3.0.00 (20161115)

build.py

@@ -1,39 +1,14 @@
 #!/usr/bin/env python3
-## INFO ########################################################################
-##                                                                            ##
-##                   Python and Cython Syntax Highlighters                    ##
-##                   =====================================                    ##
-##                                                                            ##
-##                       Version: 2.0.00.081 (20141101)                       ##
-##                               File: build.py                               ##
-##                                                                            ##
-##            For more information about the project, please visit            ##
-##                   <https://github.com/petervaro/python>.                   ##
-##                    Copyright (C) 2013 - 2014 Peter Varo                    ##
-##                                                                            ##
-##  This program is free software: you can redistribute it and/or modify it   ##
-##   under the terms of the GNU General Public License as published by the    ##
-##       Free Software Foundation, either version 3 of the License, or        ##
-##                    (at your option) any later version.                     ##
-##                                                                            ##
-##    This program is distributed in the hope that it will be useful, but     ##
-##         WITHOUT ANY WARRANTY; without even the implied warranty of         ##
-##            MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.            ##
-##            See the GNU General Public License for more details.            ##
-##                                                                            ##
-##     You should have received a copy of the GNU General Public License      ##
-##     along with this program, most likely a file in the root directory,     ##
-##        called 'LICENSE'. If not, see <http://www.gnu.org/licenses>.        ##
-##                                                                            ##
-######################################################################## INFO ##
+## INFO ##
+## INFO ##
 
 # Import python modules
 from os.path import join
 
 # Module level constants
 CURRENT_DIR = '.'
-LANG_PATH  = join(CURRENT_DIR, 'langs')
-THEME_PATH = join(CURRENT_DIR, 'themes')
+LANG_PATH   = join(CURRENT_DIR, 'langs')
+THEME_PATH  = join(CURRENT_DIR, 'themes')
 
 # Import cutils modules
 try:
@@ -72,22 +47,19 @@
               'scope': 'python.3',
               'comments' : {'lines': '# '},
               'test_name': 'Python3_TEST',
-              'test_path': '~/Library/Application Support/Sublime Text 3/'
-                           'Packages/User/Python3_TEST'}
+              'test_path': '~/.config/sublime-text-3/Packages/User/Python3_TEST'}
 
 cy_details = {'name' : 'Cython',
               'path' : LANG_PATH,
               'scope': 'cython',
               'comments' : {'lines': '# '},
               'test_name': 'Cython_TEST',
-              'test_path': '~/Library/Application Support/Sublime Text 3/'
-                           'Packages/User/Cython_TEST'}
+              'test_path': '~/.config/sublime-text-3/Packages/User/Cython_TEST'}
 
 gl_details = {'name': 'Gloom',
               'path': THEME_PATH,
               'test_name': 'Gloom_TEST',
-              'test_path': '~/Library/Application Support/Sublime Text 3/'
-                           'Packages/User/Gloom_TEST'}
+              'test_path': '~/.config/sublime-text-3/Packages/User/Gloom_TEST'}
 
 # NOTE: Old path to theme files => DO NOT SUPPORT IT:
 # '~/Library/Application Support/Sublime Text 3/Packages/Color Scheme - Default'