search

DeepGraphLearning / graphvite

GraphVite: A General and High-performance Graph Embedding System
https://graphvite.io
Apache License 2.0
1.23k stars 154 forks source link

Running out of memory when loading pre-trained embeddings #114

Open mortenterhart opened 11 months ago

mortenterhart commented 11 months ago

I'm running a laptop with an RTX 3070 GPU, an AMD Ryzen 9 5900HX processor and 16 GB RAM on Linux Mint. When trying to load the transe_wikidata5m.pkl model as following

with open('./transe_wikidata5m.pkl', 'rb') as embeddings_file:
    transe_embedding = pickle.load(embeddings_file)

I'm running out of memory and the process gets killed by the OS after some freezing time. I don't have access to another machine at the moment. Is there any alternative way of loading the model or are there smaller versions available?

I would be grateful for any help.

zhangxy22 commented 5 months ago

/transe_wikidata5m.pkl Where does a similar pkl file like fb15k_237 load