Boost Bookmarks - Githubissues

yacy / yacy_search_server

Distributed Peer-to-Peer Web Search Engine and Intranet Search Appliance

http://yacy.net

Other

3.36k stars 424 forks source link

Boost Bookmarks #229

Open hurrgadev opened 5 years ago

hurrgadev commented 5 years ago

Has anyone ever tried to boost bookmarks? Have there been any considerations? Search results of subdomains saved as bookmarks are more relevant for me. How can this best be realized?

luccioman commented 5 years ago

Hi @hurrgadev , personally I would also like to have such a feature. Unfortunately until now it remained in my TODO list and I didn't seriously try to dig the subject. As far as I know, the SearchEvent.postRanking function could be a good candidate place to apply this kind of optional boost.

hurrgadev commented 5 years ago

Thanks @luccioman. Boosting works excellently there. But the search results are not always sorted in the right order. With the Peer-to-Peer search the sorting works temporarily (remote search resorting is automated). With the private search, it's almost impossible.

luccioman commented 5 years ago

Good point @hurrgadev , for a proper pagination, indeed boosting bookmarked URLs should be done earlier, expressing it in the Solr query itself ideally.

So comes another idea to test :

crawl (regularly) your own peer /Bookmarks.html or /api/bookmarks/posts/all.xml page
then bookmarks links are in the Solr index
in the end you may be able to craft a custom Solr boost function using this information and eventually set it up in the /RankingSolr_p.html page

hurrgadev commented 5 years ago

@luccioman At first, thanks for your great support, you are awesome. I tried to crawl this files, but it doesnt work cause of the robots.txt. I allowed to crawl everything at my peer at ConfigRobotsTxt_p.html. No Change. I'll have to look at the code. Next: Where can i find the RWI- and the Solr-Ranking-Algo? Usually the coefficients are written to sorconfig.xml. With YaCy this is different.

luccioman commented 5 years ago

Arr, that is possible there is an issue with robots.txt cache... You can clear it with the /ConfigHTCache_p.html page.

YaCy ranking coefficients are customizable in the /RankingSolr_p.html and /RankingRWI_p.html page, from the "Ranking and Heuristics" admin menu.

hurrgadev commented 5 years ago

@luccioman Sorry for the late answer. Are you interested in a fork pull request? I have made some changes and would like to support the project. The first pull request is that users with bookmark right are allowed to set bookmarks on yacysearch.html. Until now only admin and users with admin right were allowed to do this.

luccioman commented 5 years ago

Ok @hurrgadev , yes your contribution will be welcome.