Add input preprocessing into lines, then tokenize only per line

[BohlSeb]

std::regex has no flag to switch of the global m multiline flag, so the lexer cannot tokenize the complete input string. Preprocess the input so that the lexer does not encounter new lines.