c2siorg / Project-Explainer

Set of tools to explain github repositories using large language models
https://huggingface.co/spaces/SriPravallikaB/projectexplainer
Apache License 2.0
17 stars 16 forks source link

feat: Implementation of evaluation metrics for Knowledge Graphs #41

Open debrupf2946 opened 2 months ago

debrupf2946 commented 2 months ago

Implement Python Code for Knowledge Graph Evaluation Metric

Description

This issue invites contributors to implement a Python version of evaluation metrics proposed by other contributors. These metrics are essential for assessing the quality and performance of our knowledge graphs, and your implementation will directly contribute to enhancing our project's evaluation framework.If you would like to propose metrics, check #40

Objective

Guidelines

  1. Select a Metric: Review the issues tagged with metric-proposal to choose an evaluation metric that interests you and has not been implemented yet.
  2. Understand the Metric: Carefully read the detailed review provided in the metric proposal issue, focusing on what it measures, how it measures, and any implementation notes.
  3. Develop the Code: Implement the metric in Python, ensuring it aligns with the described methodology and requirements.
  4. Document Your Work:
    • Include docstrings to explain your code clearly.
    • Provide comments where necessary to make the code understandable.
    • Jupyter notebook implementation of metric.
  5. Submit a Pull Request (PR):
    • Reference the original metric proposal issue in your PR.
    • Include a brief description of your implementation, any challenges faced, and how you tested the metric.

Resources

Submission Checklist

We appreciate your contributions and look forward to your implementations enhancing our knowledge graph evaluation capabilities!

Kitsunnneee commented 6 days ago

Hello @debrupf2946, Will it be okay to assign this issue to me, sir? I have previous experience in research in Hybrid-RAG systems and LLM fine tuning.

debrupf2946 commented 5 days ago

@kmehant Can I assign @Kitsunnneee for this issue?