search

StampyAI / stampy

A Discord bot for the Robert Miles AI server
37 stars 9 forks source link

42% of integration tests don't pass #284

Open ProducerMatt opened 1 year ago

ProducerMatt commented 1 year ago

Admittedly this number is exaggerated. The majority of failures come from Question-related modules, which I don't have API keys for and therefore can't work.

ProducerMatt commented 1 year ago

What is this? Is it supposed to be getting a DDG definition?

`TEST #6: FAILED`
The sent message was: "TEST_MESSAGE 6: what is deep learning?"
The expected message was "RegEx: Deep learning is part of a broader family of machine learning method"
The received message was "Perhaps this can answer your question? https://aisafety.info?state=8XBK_"
Aprillion commented 1 year ago

yup, a test from duckduckgo, you can search for "what is deep learning?" in the code:

https://github.com/StampyAI/stampy/blob/1129a10a2117d2bd37b0b5d41210afa41dd9a8c6/modules/duckduckgo.py#L123-L124

not sure what would be a reliable test that wouldn't be overruled by other modules in the future - feel free to delete fragile tests for now if you won't figure out how to replace them with something more stable 🤔