Core upgrade

[d47081]

Thoughts to change DB structure or/and current search model implementation.

As the project have no releases yet, current repository could be separated to the sphinxway branch.

By this way, following changes could be wanted:

• Rewrite crawler
  • Make it more flexible for changes (currently it's monolith)
  • Improve multimedia index / caching
  • Improve content semantics by internal content parsing to the ranked keywords
• Framework for web UI
• Make installation simpler for distributed usage
• Add more features related with snaps exploring

imho, as the basement, perspective replacement for sphinx engine is https://github.com/manticoresoftware/manticoresearch

Main goal for the future changes - make search useful by collected experience.

[d47081]

Also, would be cool to split one huge DB to the small private / independent clusters, where users able to index their resources and pull them to the distributed API.

At this moment, with ~1M of pages, YGGo requires about 3 Gb of RAM memory and that's could be issue with data grow

So I want to relocate data from the super-nodes model, make it more lightweight, more relevant with that (as small data volumes manually operated by website owners usually better than stupid daemon ranker)

[d47081]

I have started experimental project in separated repository https://github.com/YGGverse/Yo