search

higgood / seechat-folks

4 stars 1 forks source link

Improve paper ranking. #53

Open wammar opened 4 months ago

wammar commented 4 months ago

Is your feature request related to a problem? Please describe. As we explore more algorithms for hypothesis generation, we need to make further improvements in the hypothesis ranking module to ensure that the best idea manifestations have a higher chance of seeing the light.

Describe the solution you'd like This is discussed in a private thread on slack. Only members of the engineering team has access to this.

Describe alternatives you've considered @ahmadshapiro is working on a relevant R&D project outside the critical path. Please coordinate the interface with him to make sure it will be easy to integrate his work at some point.

Additional context N/A

muhammadnasr commented 3 months ago

@wammar blocked by https://github.com/higgood/seechat/issues/248

wammar commented 2 months ago

https://github.com/higgood/seechat/issues/248 is not a blocker.

@Mox301 Please use the slack thread I linked earlier for more details on how to implement this.

wammar commented 1 month ago

Next step is for @Mox301 to carefully review the slack thread, and scope the work needed here, with clear steps (which can be done and reviewed in less than 1 week). Please get approval from Bridger before starting the actual implementation.

wammar commented 2 weeks ago

This task was re-scoped to focus on creating an evaluation set for paper relevance. The remaining scope will be assigned in a later date.

Ahmed-Habashy commented 1 week ago

We started a collaboration with Columbia University to develop a systematic evaluation or for problem driven retrieval of scientific literature.