DeepGraphLearning / ULTRA

A foundation model for knowledge graph reasoning
MIT License
478 stars 64 forks source link

ULTRA-LM: Language model integration for ULTRA #24

Closed daniel4x closed 3 months ago

daniel4x commented 3 months ago

ULTRA-LM

Hi @migalkin , per my issue here I finally had some time to refactor part of my code and pack it into a PR.

It is worth mentioning that I've also contributed an additional dataset combining KG and textual embeddings. The embeddings are currently provided as a separate download link.

Changes:

daniel4x commented 3 months ago

Hi @migalkin Any chance you've had the opportunity to look into this PR?

migalkin commented 3 months ago

Hi Daniel, thanks for the PR, it indeed touches upon one of the most requested features!

The new features are pretty nice but I have hard time reproducing them because there is no link to the pickle file with the precomputed LLM features. Generally, in order to be merged with the main branch, the PR will need a bit more work to encompass more datasets and possible usecases:

Let me know what you think. We also have an ongoing effort in a similar direction, it might be ready in a month or so.

daniel4x commented 3 months ago

@migalkin thanks.

Indeed, I agree. In my case, this branch was tailor-made for my research, as I was using a single graph with LM. I am glad to hear about the ongoing effort and am looking forward to learning more about it (and even contributing when/if possible 😉).

I believe you can close the PR, or you can leave it open for future reference.