[Refactoring] Token based parser

[magicant]

This refactoring is a preparation for implementing the [[ command and improving POSIX conformance.

In this refactoring, the parser is restructured into the tokenizer and syntax parser.

[magicant]

The remaining todos:

• [x] Update po files.
• [x] Update the formal syntax definition in the manual.