gunnarmorling / 1brc

1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java
https://www.morling.dev/blog/one-billion-row-challenge/
Apache License 2.0
6k stars 1.8k forks source link

Final submission #669

Closed merykitty closed 6 months ago

merykitty commented 7 months ago

Some small improvements:

Some that I have tried:

Check List:

tarsa commented 7 months ago
  • Spawning a separate process to hide the cost of unmapping: It is likely that the cost of initializing the VM is higher than the cost of unmap, I did not see improvements.

it seems there's another trick to try: https://github.com/gunnarmorling/1brc/blob/7f0e51781190bcfcd4b8624352230a19737b01c8/src/main/java/dev/morling/onebrc/CalculateAverage_serkan_ozal.java#L171-L176 along with https://github.com/gunnarmorling/1brc/blob/7f0e51781190bcfcd4b8624352230a19737b01c8/calculate_average_serkan-ozal.sh#L31-L35

gunnarmorling commented 6 months ago

Nice!

# Result (m:s.ms) Implementation JDK Submitter Notes
00:02.367 link 21.0.1-open Quan Anh Mai uses Unsafe
00:03.210 link 21.0.1-open Quan Anh Mai
gunnarmorling commented 6 months ago

Hey @merykitty, couldn't find another way to reach out to you, so commenting here: would you perhaps be interested in teaming up with Thomas, Roy, Elliot, and me for doing a live stream on #1BRC tomorrow with Nicolai Parlog: https://twitter.com/gunnarmorling/status/1752288991909478611. As one of the fastest JVM-based implementations, it would be great to have your perspective on the challenge. Let me know :)

merykitty commented 6 months ago

@gunnarmorling I would be more than happy to join. Can you give me more information regarding the subjects or what can I contribute to the conversation? My email is anhmdq99@gmail.com.

gunnarmorling commented 6 months ago

Perfect, I've added you to the DM chat with the other participants. Thanks a lot, looking forward to it!

Message ID: @.***>