Bookworm-project / BookwormDB

Tools for text tokenization and encoding
MIT License
84 stars 12 forks source link

Straight line graph #93

Open tpmccallum opened 8 years ago

tpmccallum commented 8 years ago

Just wondering what causes the Bookworm to draw a straight line graph. I have attached an image which shows this. chart 1

Thanks Tim

tpmccallum commented 8 years ago

Hi, I have received a complaint about how the Bookworm draws a straight line. The users say they get frustrated when they receive something like [http://openaccess.xyz/#?%7B%22search_limits%22%3A%5B%7B%22word%22%3A%5B%22asia+pacific+tourism%22%5D%2C%22date_year%22%3A%7B%22%24gte%22%3A1967%2C%22%24lte%22%3A2017%7D%7D%5D%7D]

http://openaccess.xyz/#?%7B%22search_limits%22%3A%5B%7B%22word%22%3A%5B%22asia+pacific+tourism%22%5D%2C%22date_year%22%3A%7B%22%24gte%22%3A1967%2C%22%24lte%22%3A2017%7D%7D%5D%7D

I am not 100% sure what causes this and in the case of the straight line the results seem to be off topic.

Is there any diagnosis which I can do on the backend?

Any help will be appreciated.

Tim

tpmccallum commented 8 years ago

I have just noticed that it is only the trigram searches which draw the straight line graph (single and double word search is OK).

http://openaccess.xyz/ngram.html

Also I see that the .bookworm/texts/encoded/trigrams directory is empty

Is there a way to fix this (running partial piece of code to populate the trigram information?

Any help would be greatly appreciated.

Tim