whirlwind-match / fuzzydb

fuzzydb is a fuzzy matching database engine capable of providing human-like search results that make life much easier for users of websites searching for things like cars, houses, people and jobs.
19 stars 5 forks source link

Radically reduce data transfer for search results to scores + ref in binary #72

Open nealeu opened 12 years ago

nealeu commented 12 years ago

Significant load on client and server will be around serialization of data to/from server.

We need a front end layer that can take a POJO and map the relevant bits into a whirlwind index, and the rest can go somewhere else for storage.

Our own annotations of what fields to index and map at client side would certainly be beneficial. Also, we can get screaming write perf if we remove the possibility of getting a KeyCollisionException by putting unique keys elsewhere. We just go on unique Ref (i.e. our own @Id)