parseablehq / parseable

Open Source ElasticSearch Alternative. Parseable helps you search and get insights from your logs in the most simple way possible.
https://parseable.com
GNU Affero General Public License v3.0
1.78k stars 92 forks source link

PGO + Bolt #224

Open zamazan4ik opened 1 year ago

zamazan4ik commented 1 year ago

parseable right now does not support building with more advanced optimization techniques like PGO and BOLT. This tooling has an increasing adoption in the community as a tool to additionally optimize programs. With this tooling, there is a huge chance to gain even more performance "for free".

Here I suggest considering an option at least to play with LTO ("fat" version) + PGO + Bolt pipeline (or any combination of them) and test, does it give a performance to the project or not. If yes, would be awesome to have prebuilt binaries with more advanced optimization from the scratch. Also, for the users will be helpful to have the ability to tweak manually their own binaries to their own workloads with the integrated into the build scripts functionality.

Since the project is quite small I do not expect (at least yet) significant improvement from the PGO right now. But at least a good option to try :)

Also, there are some caveats to consider like:

Links:

nitisht commented 1 year ago

Thank you for the issue @zamazan4ik we’ll review the blog post, looks interesting for sure - but as you said, at our current size it may not be the most useful.

nitisht commented 1 year ago

Closing this for now because we don't have cycles to explore this. We may get to this at a later stage

zamazan4ik commented 10 months ago

@nitisht I suggest you re-open the issue, so someone in the future can start working on it since the issue will be open.

nitisht commented 10 months ago

Thanks @zamazan4ik . Reopening now..