Improve Shader Compressor

[LeStahL]

• Shader compressor does not do anything at the moment.
• CTRL-ALT-TEST-minifier is buggy and has a bad parser, so we want to write our own minifier.
• Minification tasks (best with command line switches that enable/disable tasks):
  1. Remove CRLF from all lines except #version line.
  2. Remove all comments
  3. Replace all identifiers with shorter identifiers that compress better with kkrunchy-k7. A list with best compressing IDs has to be found for this.
  4. Replace unnecessary long floating point constants with similiar, better compressing constants.
  5. Remove unnecessary digits from floats (Replace '0.0' with '0.').
  6. ???

[LeStahL]

Links:

• CTRL-ALT-TEST-minifier
• kkrunchy
• Our 'minifier'

[LeStahL]

I would like to have a "preserve-all-globals" option, that will cause the minifier to not touch any identifiers that are file-scope (because I use a link-time trick to save the symbols only once in the executable and need reliable prototypes for it.

[LeStahL]

I included the lexer I wrote today into a rudimentary compressor that only removes CRLF, comments and (some of the) spaces. All of these optimizations are lexer-based and do not require an actual AST. symbolize.py has been updated to include the compressor. AST-based optimizations are still possible though.