-
Consider using something like plyara: https://github.com/plyara/plyara
-
Caught with parsing Fuzz tester when parsing strings of random characters. Possible the string is not even valid and lexer should fail, but warrants investigation.
-
Current implementation:
```rust
pub fn ast_from_expression(
&mut self,
s: &str,
) -> ZiaResult {
let tokens: Vec = parse_line(s)?;
self.ast_from_tokens(&tokens)
}
```
`Sh…
-
In the documentation, this example is given for Lexing with Moo:
```javascript
@{%
const moo = require("moo");
const lexer = moo.compile({
ws: /[ \t]+/,
number: /[0-9]+/,
word: /[a-…
-
This issue exists to track things we want to improve on. Please add things here:
- [ ] Replace bullets with prose.
- [ ] Perhaps move some of the content about command line parsing, lexing, and pa…
-
Count line and colum number while lexing, for error reporting
-
Clojure inherits Java's support for scientific notation: https://docs.oracle.com/javase/specs/jls/se7/html/jls-3.html#jls-3.10.2
C++'s floating point docs: https://en.cppreference.com/w/cpp/language/…
-
I was wondering if there was a way to have custom provenance information or additional metadata on tokens that you can easily get access to. The spans I use for provenance are source offsets (and I'm …
-
- [x] Whitespace removal
- [x] Comment removal
- [ ] Register renaming
- [ ] Label renaming (?)
- [x] ~~Symbol case-insensitivity~~ (included in lexing in #12)
-
R is a [widely used](https://stackoverflow.blog/2017/10/10/impressive-growth-r/), growing language often used in Data Science and Statistics.
While it does not have a published formal specification…