jdagdelen / hyperDB

A hyper-fast local vector database for use with LLM Agents. Now accepting SAFEs at $135M cap.
MIT License
1.38k stars 85 forks source link

Improve derridaean_similarity using quantum (qrng) #15

Closed Qubitium closed 1 year ago

Qubitium commented 1 year ago

derridaean_similarity is pretty damn good, after testing, but its output is entirely predicated on the quality of the random number generation.

This PR proposes an optional quantum toggle that will enable quantum random number generation using 8-qubit simulated system to provide quantifiably more robust random number output.

I did some benchmarks and quantumfied derridaean_similarity is approximately 3.5m (m as in million) times slower than non-quantum but I believe the results speak for themselves. Due to the speed cost, I have set it to default to false.

p.s. Please accept my apology for premature rant in issue https://github.com/jdagdelen/hyperDB/issues/2. I have come to my senses. I wish to contribute to the hypeDB moving forward.

@rjadr @jdagdelen @jobergum