srotya / sidewinder

Fast and scalable timeseries database
http://sidewinder.srotya.com
Apache License 2.0
25 stars 10 forks source link

Several Performance and Scalability improvements #97

Closed ambud closed 6 years ago

ambud commented 6 years ago

Creating memory mapped tag index for faster performance

Enabling garbage collector implementation for persistent storage

Refactoring ingesters so they can be externally plugged in

Refactoring and adjusting modules for performance

Reducing monitoring thread count using bgtask pool

codecov-io commented 6 years ago

Codecov Report

Merging #97 into development will increase coverage by 1.49%. The diff coverage is 51.54%.

Impacted file tree graph

@@                Coverage Diff                @@
##             development      #97      +/-   ##
=================================================
+ Coverage          46.02%   47.52%   +1.49%     
- Complexity           709      798      +89     
=================================================
  Files                130      134       +4     
  Lines               4897     5378     +481     
  Branches             507      595      +88     
=================================================
+ Hits                2254     2556     +302     
- Misses              2499     2642     +143     
- Partials             144      180      +36
Impacted Files Coverage Δ Complexity Δ
...ya/sidewinder/core/utils/HTTPDataPointDecoder.java 27.48% <ø> (ø) 9 <0> (ø) :arrow_down:
...sidewinder/core/monitoring/RestAPIHealthCheck.java 5% <ø> (ø) 1 <0> (?)
...ya/sidewinder/core/storage/compression/Writer.java 100% <ø> (ø) 1 <0> (ø) :arrow_down:
...idewinder/cluster/storage/SidewinderWALClient.java 0% <ø> (ø) 0 <0> (ø) :arrow_down:
.../com/srotya/sidewinder/core/storage/DataPoint.java 83.33% <ø> (ø) 17 <0> (ø) :arrow_down:
...sidewinder/ingesters/graphite/GraphiteDecoder.java 66.66% <ø> (ø) 6 <0> (?)
.../sidewinder/cluster/SidewinderClusteredServer.java 0% <0%> (ø) 0 <0> (ø) :arrow_down:
.../sidewinder/ingesters/graphite/GraphiteServer.java 0% <0%> (ø) 0 <0> (?)
...winder/core/storage/compression/dod/DodWriter.java 45.61% <0%> (-1.24%) 12 <0> (ø)
.../srotya/sidewinder/core/api/MeasurementOpsApi.java 24.52% <0%> (-1.74%) 8 <0> (ø)
... and 51 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 0349b0e...fca8ed2. Read the comment docs.