Add metrics calculations to the inference pipeline

RashmikaReddy commented 9 months ago

Change Description

Adding changes to add metrics to the inference pipeline in main.py. Added unit test case in test_main.py closes #2

[https://github.com/AutoResearch/autodoc/issues/2]

Solution Description

Added BLEU, METEOR evaluation metrics to the inference pipeline.

BLEU score calculation https://www.baeldung.com/cs/nlp-bleu-score#:~:text=BLEU%20(Bilingual%20Evaluation%20Understudy)%20is,%2Danswering%20systems%2C%20and%20chatbots. METEOR score calculation https://huggingface.co/spaces/evaluate-metric/meteor

Code Quality

[Yes] I have read the Contribution Guide
[Yes] My code follows the code style of this project
[Yes] My code builds (or compiles) cleanly without any errors or warnings
[Yes] My code contains relevant comments and necessary documentation

Project-Specific Pull Request Checklists

codecov[bot] commented 9 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (45bd148) 95.83% compared to head (368e73c) 96.32%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #23 +/- ## ========================================== + Coverage 95.83% 96.32% +0.49% ========================================== Files 3 3 Lines 120 136 +16 ========================================== + Hits 115 131 +16 Misses 5 5 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

codecov-commenter commented 8 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (fdcce7e) 96.15% compared to head (9fcd8ec) 96.57%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #23 +/- ## ========================================== + Coverage 96.15% 96.57% +0.42% ========================================== Files 3 3 Lines 130 146 +16 ========================================== + Hits 125 141 +16 Misses 5 5 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

RashmikaReddy commented 8 months ago

Closing the Pull Request for evaluation metrics

AutoResearch / autodoc