stanfordnlp / dspy

DSPy: The framework for programming—not prompting—foundation models
https://dspy-docs.vercel.app/
MIT License
18.62k stars 1.43k forks source link

Specified module not found in trace [dspy.primitives.assertions] filename=assertions.py lineno=251 #1470

Closed YichiRockyZhang closed 1 month ago

YichiRockyZhang commented 2 months ago

I'm seeing the above error often, even in the provided notebooks. Is it harmless? It can be silenced by removing the target_module from Suggest/Assert.

Notebooks where I've seen this issue: tweets_assertions.ipynb longformqa_assertions.ipynb quiz_assertions.ipynb

See attached gist

0%|          | 0/1 [00:00<?, ?it/s]ERROR:dspy.primitives.assertions:2024-09-09T14:48:50.244481Z [error    ] Specified module not found in trace [dspy.primitives.assertions] filename=assertions.py lineno=251
okhat commented 2 months ago

Thanks for opening this, @YichiRockyZhang !

Tagging @arnavsinghvi11 @Shangyint

YichiRockyZhang commented 2 months ago

Thanks for the quick response! :)

okhat commented 2 months ago

@YichiRockyZhang Until we have people looking into this, what is your goal from using assertions? We're trying to make improvements to assertions and would love to understand more use cases people have for them.

YichiRockyZhang commented 2 months ago

@okhat Generating quizbowl questions! They have a unique format. Here are some resources to understand them. Feel free to ping/email me to discuss it further.

Quizbowl: The Case for Incremental Question Answering (Rodriguez, Feng, Iyyer, He, Boyd-Graber) Protobowl