search

heavyai / heavydb

HeavyDB (formerly OmniSciDB)
https://heavy.ai
Apache License 2.0
2.95k stars 448 forks source link

DB-Server configuration recommendation #613

Open cmdares opened 3 years ago

cmdares commented 3 years ago

Massive data needs to be analyzed by using database. It is reasonable to configure how many GB of large memory for a single server dataBase: all tables 10 / all rows 8Billion Hot area data:3 Billion CPU:Intel Xeon Silver 4210 10Core 3.2GHz GPU:RTX 3090 24GB * 8 cards Mem:??? thanks.

cdessanti commented 3 years ago

Hi @cmdares,

It's not an easy task to assess the memory needed by an application, without knowledge of the data itself and how the data will be interrogated, but you can refer to a section of our docs that try to answer questions like this one.

Check this to get some considerations of how the GPU and CPU memory is used

https://docs-new.omnisci.com/installation-and-configuration/system-requirements/hardware#hot-records-and-columns

This one contains a table with estimates based on some assumptions

https://docs-new.omnisci.com/installation-and-configuration/system-requirements/hardware#hardware-sizing-schedule.

As stated in the docs, with different needs/data the memory and the GPUs needed to analyze the data could differ

Regards

cmdares commented 3 years ago

thanks.