search

gipplab / mathosphere

Apache License 2.0
6 stars 7 forks source link

Check if LatexTokenizer is tokenizing correctly #3

Open jimmyli97 opened 10 years ago

jimmyli97 commented 10 years ago

other: keep or remove qvars?

physikerwelt commented 10 years ago

I don't understand the question.

jimmyli97 commented 10 years ago

sorry, clarification: some things such as \varepsilon get removed that we might want to keep

also, did you get my question about the results you submitted? they were missing 1000 lines for a query

On Mon, Jul 14, 2014 at 9:49 AM, Moritz Schubotz notifications@github.com wrote:

I don't understand the question.

— Reply to this email directly or view it on GitHub https://github.com/TU-Berlin/mathosphere2/issues/3#issuecomment-48901523 .

jimmyli97 commented 10 years ago

more clarification: not \varepsilon (bad example), but things like subscripts (_{...}) are lost when tokenized that we might want to keep such \nu

at the very least it should be consistent so that for example \delta should not be represented if \nu is not also represented

On Mon, Jul 14, 2014 at 11:50 AM, Jimmy Li jimmy.jiajian.li@gmail.com wrote:

sorry, clarification: some things such as \varepsilon get removed that we might want to keep

also, did you get my question about the results you submitted? they were missing 1000 lines for a query

On Mon, Jul 14, 2014 at 9:49 AM, Moritz Schubotz <notifications@github.com

wrote:

I don't understand the question.

— Reply to this email directly or view it on GitHub https://github.com/TU-Berlin/mathosphere2/issues/3#issuecomment-48901523 .

physikerwelt commented 10 years ago

I still don't understand. Maybe you can make a simple example: What's the query? Which results matches and which result does not match.