Tokens within Tokens

[GoogleCodeExporter]

The current implementation cannot support tokens to be embedded within
tokens.  Something like a Groovy ${val} in a Groovy String cannot be
highlighted.  Only the Complete String can be highlighted.

This change requires a slightly major refactoring of the way {{{Tokens}}}
are returned to the {{{SyntaxDocument}}}, and possibly in the
{{{SyntaxView}}} to handle overlapping tokens.  The {{{Lexers}}} will also
need to change to use proper states instead of just Regexp for some constructs.

But the possibilities are very nice indeed.  Highlighting JavaDocs, and
Groovy Strings will look very nice.

Anybody interested in having this?  If so, please add a comment and if
demand is there, I'll push it up the list of things to do.

Original issue reported on code.google.com by ayman.al...@gmail.com on 1 Jul 2008 at 10:06

[GoogleCodeExporter]

Original comment by ayman.al...@gmail.com on 7 Jul 2008 at 6:41

• Changed state: WontFix

[GoogleCodeExporter]

Hi,

I just discovered your project yesterday evening and I'm very impressed and 
amazed 
by its features and the simple usage. I'm using it for groovy code syntax 
highlighting, so yes I'm interested in!

By the way a string like "this is a string with the value of variable a = $a 
inside" 
isn't highlighted correctly (in version 0.9.3a). The end of the string isn't 
proper 
marked. Or is it a feature that the last quotation mark is black? At the moment 
I'm 
quite busy and have not found the time to have a quick look at the source code, 
sorry for that. Here a short example:

int a = 10
String atest= "a = $a"

Thanks again for this great project!

Cheers,
Matthias

Original comment by matthias...@gmail.com on 12 Nov 2008 at 9:20

[GoogleCodeExporter]

Hi,

Thanks for the kind words.

Send you your google account email so I can add you as a member if you want.  
Or just
join the group.  It's been quiet for a while now, though.

The un-highlighted quote is probably a bug.  I did not pay that much attention 
to an
escap char without the curly braces.  I'll work on that.

Original comment by ayman.al...@gmail.com on 13 Nov 2008 at 5:11

• Changed state: Fixed