Hierarchical Clustering - Githubissues

mnm-matin / ai_alignment_graph

https://mnm-matin.github.io/ai_alignment_graph/

MIT License

9 stars 2 forks source link

Hierarchical Clustering #13

Open mnm-matin opened 3 months ago

mnm-matin commented 3 months ago

Cluster AI Safety Research Papers into:

Main Topic -> Sub Topic -> Research Paper

Current Approach and Limitation

llm_cluster_batched.py takes 20 papers and uses an LLM (Claude Sonnet) to create subtopics given a seed of main topics llm_cluster_start.yaml

Neo4j Clustering using llm-graph-builder

Knowledge Graph, second one is an entity graph

LLM Approach (Graph Maker)

Embedding Based Approach

possible to use embedding approach, openai-embedding