arXiv / arxiv-search

arXiv Search UI & APIs
https://arxiv.github.io/arxiv-search/
MIT License
96 stars 15 forks source link

Consider using approach0 approach for advanced searching of math expressions #256

Open TheSil opened 4 years ago

TheSil commented 4 years ago

By this issue I'd like to bring attention to advanced search engine, which could be perhaps used for arXiv as well (or at least the ideas). It is currently used for Mathematics Stack Exchange (MSE), you can try it here: https://approach0.xyz/search/

It is very effective because it is sort of "aware" of the math in expressions being searched, it can for example find expressions that are made by substitutions, you can read about it more here:

https://twitter.com/approach0 https://approach0.xyz/guide/ https://math.meta.stackexchange.com/questions/24978/announcing-a-third-party-search-engine-for-math-stackexchange https://www.researchgate.net/publication/332257209_Structural_Similarity_Search_for_Formulas_Using_Leaf-Root_Paths_in_Operator_Subtrees https://github.com/approach0/search-engine

Definitely it would be a lot of effort, but I think it is worth considering. On MSE this easily outperforms classic text search engine, for searching in (not only) math articles it could be even more useful.