gunnarmorling / 1brc

1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java
https://www.morling.dev/blog/one-billion-row-challenge/
Apache License 2.0
5.69k stars 1.72k forks source link

Spread work more evenly between threads #700

Closed ianopolousfast closed 5 months ago

ianopolousfast commented 5 months ago

Vectorize skipping first partial line

Check List:

gunnarmorling commented 5 months ago

Also not a measurable improvement:

Benchmark 1: timeout -v 300 ./calculate_average_ianopolousfast.sh 2>&1
  Time (mean ± σ):      4.809 s ±  0.032 s    [User: 34.389 s, System: 0.749 s]
  Range (min … max):    4.781 s …  4.860 s    5 runs

Summary
  ianopolousfast: trimmed mean 4.800795321993334, raw times 4.78106628766,4.81001773666,4.860319667660001,4.80970452866,4.782663700660001

Leaderboard

| # | Result (m:s.ms) | Implementation     | JDK | Submitter     | Notes     |
|---|-----------------|--------------------|-----|---------------|-----------|
|   | 00:04.800 | [link](https://github.com/gunnarmorling/1brc/blob/main/src/main/java/dev/morling/onebrc/CalculateAverage_ianopolousfast.java)| 21.0.1-open | [Dr Ian Preston](https://github.com/ianopolousfast) |  |