search

IDEA-FinAI / ToG

This is the official github repo of Think-on-Graph. If you are interested in our work or willing to join our research team in Shenzhen, please feel free to contact us by email (xuchengjin@idea.edu.cn)
238 stars 26 forks source link

Memory needed for wikidata server #5

Closed alomrani closed 6 months ago

alomrani commented 6 months ago

Hello,

After running the wikidata servers for each chunk, my server crashes due to running out of RAM. How much memory does each server consume?

Thanks, Mohammad

GasolSun36 commented 6 months ago

@SaizhuoWang Maybe you can help answer this question.😄

SaizhuoWang commented 6 months ago

Hi, thanks for your interest in our work.

Approximately, each chunk takes ~170G of memory and it is suggested to prepare ~1.5-2T total memory to run the server. In case this amount of memory is not available on a single server node, you may also try running different chunks at different nodes, and you just need to make sure that the client can access all these nodes.