Please review these changes. I'm not a C++ programmer so feel free to let me know if I need to change anything.
options.h contains struct options and parsing of argc and argv
dialect_t dialect of the source to produce (TRANSFORMED, XSB, SWIPL, SOUFFLE)
format_t for format of the resulting data (TML is default, CSV not fixed yet)
tokens_format_t for format of tokens
tokens (for example for syntax highlighting for editors/playground):
--tokens produces TML: token(symbol 4 6). token(variable 8 13).
--tokens-json produces JSON: { "tokens": [ { "token": "symbol", "from": 4, "to": 6 }, ...
--tokens-xml produces source with token tags <symbol>v1</symbol> <variable>?var12</variable>
--tokens-html produces source with HTML spans <span class="symbol">v1</span> <span class="variable">?var12</span>
Please review these changes. I'm not a C++ programmer so feel free to let me know if I need to change anything.