[x] Implement template parser to standard IO objects
Template tokenizer is implemented as streamed tokenizer using async iterable protocol which allows to feed in chunks of strings asynchronously and get tokens as soon as possible with minimal memory footprint.
This will allow to create a streamed parser which will contribute in less peak memory usage and more distributed/chunked processing which should result in a better/smoother load on a thread.
This is a POC to enable Angular templating syntax in IO input string as described in https://github.com/gund/ng-dynamic-component/discussions/484.
Template tokenizer is implemented as streamed tokenizer using async iterable protocol which allows to feed in chunks of strings asynchronously and get tokens as soon as possible with minimal memory footprint.
This will allow to create a streamed parser which will contribute in less peak memory usage and more distributed/chunked processing which should result in a better/smoother load on a thread.