Closed pke closed 10 months ago
Currently the AST that is returned from the currently exported functions is not entirely correct, especially with images in the markdown.
tokensToAST(stringToTokens(markdown))
returns a different (and wrong) AST than:
tokensToAST(groupTextTokens(cleanupTokens(stringToToken(markdown))))
Howver groupTextTokens and cleanupTokens are not officially exported. I wonder if we could just move this kind of processing into tokensToAST or is there a time those cleanups would not be performed?
groupTextTokens
cleanupTokens
tokensToAST
Just stumbled over a code comment referencing this issue. Have you considered the proposal @iamacup?
hey @iamacup I see a lot of old issues marked as completed but fail to see the commits? What's going on?
Currently the AST that is returned from the currently exported functions is not entirely correct, especially with images in the markdown.
returns a different (and wrong) AST than:
Howver
groupTextTokens
andcleanupTokens
are not officially exported. I wonder if we could just move this kind of processing intotokensToAST
or is there a time those cleanups would not be performed?