srotya / sidewinder

Fast and scalable timeseries database
http://sidewinder.srotya.com
Apache License 2.0
25 stars 10 forks source link

Time series refactoring & SQL / JDBC integration #129

Closed ambud closed 6 years ago

ambud commented 6 years ago

Adding refactoring of time series internals to add true columnar storage with iterators and independent predicate push down. Adding Apache Calcite integrations with Avatica jdbc server for ANSI SQL queries on data.

New refactored time series reduces memory footprint by caching and reusing objects thereby allowing more series to be run on a smaller footprint machine. (360K unique series with 4M+ columns on 6GB heap and 16GB total memory)

codecov-io commented 6 years ago

Codecov Report

Merging #129 into development will increase coverage by 1.28%. The diff coverage is 70.27%.

Impacted file tree graph

@@                Coverage Diff                @@
##             development     #129      +/-   ##
=================================================
+ Coverage          55.88%   57.16%   +1.28%     
- Complexity           898      978      +80     
=================================================
  Files                116      122       +6     
  Lines               5438     5825     +387     
  Branches             645      690      +45     
=================================================
+ Hits                3039     3330     +291     
- Misses              2221     2294      +73     
- Partials             178      201      +23
Impacted Files Coverage Δ Complexity Δ
...ava/com/srotya/sidewinder/core/storage/NoLock.java 42.85% <ø> (ø) 3 <0> (?)
...sidewinder/core/storage/archival/NoneArchiver.java 50% <ø> (ø) 2 <0> (ø) :arrow_down:
...winder/core/monitoring/MetricsRegistryService.java 95.23% <ø> (ø) 7 <0> (ø) :arrow_down:
...tya/sidewinder/core/storage/archival/Archiver.java 0% <ø> (ø) 0 <0> (?)
...otya/sidewinder/core/api/grafana/GrafanaUtils.java 27.9% <0%> (ø) 10 <0> (ø) :arrow_down:
...ore/storage/processor/PointProcessorDisruptor.java 0% <0%> (ø) 0 <0> (ø) :arrow_down:
...ya/sidewinder/core/monitoring/ResourceMonitor.java 0% <0%> (ø) 0 <0> (ø) :arrow_down:
.../srotya/sidewinder/core/api/MeasurementOpsApi.java 0% <0%> (ø) 0 <0> (ø) :arrow_down:
...java/com/srotya/sidewinder/core/api/InfluxApi.java 0% <0%> (ø) 0 <0> (ø) :arrow_down:
...sidewinder/core/functions/MultiSeriesFunction.java 0% <0%> (ø) 0 <0> (ø) :arrow_down:
... and 87 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 128a385...925e6f3. Read the comment docs.