search

weld-project / weld

High-performance runtime for data analytics applications
https://www.weld.rs
BSD 3-Clause "New" or "Revised" License
2.99k stars 259 forks source link

High memory usage during compilation when using built-from-source LLVM 6.0 #477

Open sppalkia opened 4 years ago

sppalkia commented 4 years ago

As mentioned in #476, using LLVM 6.0 when built from source seems to increase rustc compilation times dramatically and also seems to increase memory usage significantly (the linker and dsysutil use > 2GB of memory per integration test module, for example). This is most likely because of the flags with which LLVM is compiled.

This issue doesn't seem to occur on a "standard" distribution of LLVM (via apt-get on Linux or brew on MacOS).