LLM Related Tasks

[mnm-matin]

There are 4 tasks related to LLMs (can break these out into separate issues as needed:

1. Hierarchical Clustering/Taxonomy Creation Main Topic -> Sub Topic -> Research Paper

2. Similar Papers Clustering For each paper find papers related to it

3. Summaries

   • Each Main Topic
   • Each Subtopic
   • Each paper (which is probably just the abstract)

4. Filter Papers Need to filter out papers not related to AI Safety

For LLM related tasks the following are pre-requisite:

• [ ] Find a python library to make the code LLM provider agnostic, e.g LiteLLM
• [ ] Fixed Data Structure JSON or YAML?