search

sfu-natlang / lensingwikipedia

Lensing Wikipedia is an interface to visually browse through human history as represented in Wikipedia. This the source code that runs the website:
http://lensingwikipedia.cs.sfu.ca
Other
11 stars 4 forks source link

tSNE Enhancements #136

Open KonceptGeek opened 9 years ago

KonceptGeek commented 9 years ago

Following are the tSNE enhancements that need to be added.

  1. Constraints added in other views should be applied in tSNE views. Only valid points should be shown.
  2. Cross-browser support for tSNE. Currently works in Chrome only. Performance on Firefox is really slow and on Safari, the bounding box coordinates are incorrect.
  3. Enable verbose mode for tSNE.
  4. Add WebGL support to improve performance.
anoopsarkar commented 9 years ago

I like these papers which describe an alternative method to layout the 2D points to make them more intuitive and it might also help with creating natural sub-groups to enable zooming into and out of pre-defined areas:

http://www.cs.arizona.edu/~kobourov/pacvis10.pdf http://www2.research.att.com/~volinsky/maps/mapslong.pdf

which like another view in lensing is also inspired by xkcd:

http://xkcd.com/256

anoopsarkar commented 9 years ago

One idea we discussed but I think is not in issues yet is the use of more sophisticated whoosh queries to get faster responses from the backend. For instance, whoosh allows for range queries which we use already for timeline year queries. It is easy enough to combine multiple such range queries to find all instances within a 2D bounding box. The backend can choose to page any request that returns too many points to the frontend.

anoopsarkar commented 9 years ago

I found why tsne was crashing. Any set of examples greater than 80,000 does not work (without PCA or with PCA, it doesn't matter).