search

castorini / ura-projects

0 stars 1 forks source link

Integrate pyserini with DSPy #11

Open lintool opened 1 year ago

lintool commented 1 year ago

https://github.com/stanfordnlp/dspy

@okhat - this get your attention? ;)

We have ugrads here in Waterloo that are potentially interested in this...

jasper-xian commented 1 year ago

I've been playing around with this, am happy to clean it up/integrate it with dspy if needed

okhat commented 1 year ago

Really excited to see this. Thanks @lintool and @jasper-xian.

Happy to help, possibly hands-on, wherever useful. Also any feedback is greatly welcome.

Just to be clear your goal is to integrate dspy into/with which castorini project?

okhat commented 1 year ago

Ah I see it says pyserini in the title.

I think the key question is that DSPy is a framework (think PyTorch; it's modeled exactly after PyTorch but for prompting/finetuning blackbox LLMs). So there may be more than one way to think about an integration with pyserini.

For a start, it's pip installable and has very few dependencies, so adding it in is easy (I think).

But you can imagine trying to implement specific DSPy modules into Pyserini. In that case, someone (me or @jasper-xian perhaps) needs to actually write (or extract from our examples) these specific modules.

okhat commented 1 year ago

following up by email, and I now understand the initial integration is the other way around, which makes more sense for a start