Closed hastagAB closed 4 years ago
The Evaluator commands are set for both two parameters i.e agent_name and similarity but some agents runs without similarity type also.
agent_name
similarity
Example: for tfidfagent there are three commands :
tfidf
atarashi -a tfidf -s CosineSim /path/to/file.c
atarashi -a tfidf -s ScoreSim /path/to/file.c
atarashi -a tfidf /path/to/file.c
The evaluator covers the first two cases and not the third one. The same goes for other agents.
Hey, @hastagAB this issue seems nice. Can I work on it?
Yes Please, Go Ahead! 👍
Description
The Evaluator commands are set for both two parameters i.e
agent_name
andsimilarity
but some agents runs without similarity type also.Example: for
tfidf
agent there are three commands :atarashi -a tfidf -s CosineSim /path/to/file.c
atarashi -a tfidf -s ScoreSim /path/to/file.c
atarashi -a tfidf /path/to/file.c
The evaluator covers the first two cases and not the third one. The same goes for other agents.
How to fix