akumuli / Akumuli

Time-series database
http://akumuli.org
Apache License 2.0
837 stars 84 forks source link

Support InfluxDb line protocol (HTTP and UDP) for data ingestion #209

Closed dmitrios closed 6 years ago

dmitrios commented 7 years ago

It would be good to support this in addition to Collector. I think InfluxDb popularity is higher because of its simplicity to ingest data. This would also allow migration from InfluxDB when needed much easier. Another option is support Prometheus format, so at least recognized TSDB protocol can be used.

dmitrios commented 6 years ago

Closing as outdated since added integration for sending metrics to Akumuli.

Lazin commented 6 years ago

This is cool. The InfluxDB's line protocol can be added at some point anyway (it's sort of non-trivial since InfluxDB has metrics, tags, and fields and Akumuli doesn't have fields, so it wouldn't one to one mapping as with OpenTSDB).

dmitrios commented 6 years ago

See example for collecting any Windows metrics (WMI, perf counters, SQL Server) on containers (Nano Server), VMs or hosts. The metric collector is free (plan to open source soon)and integrated with Prometheus, InfluxDb and now Akumuli. So, at the very least it's possible to send Windows metrics to Akumuli (to replace SCOM, etc.) and event logs to InfluxDB at the same time. Also, Akumuli looks good on Docker and K8S, but the metric volume was relatively small.

Lazin commented 6 years ago

I'm looking forward to try it when I'd have a chance. I only tested it with Linux based collectors so far.

dmitrios commented 6 years ago

Cool, the bits are in repo releases section. Please feel free to try and blog if you like it. Perhaps it would help to increase adoption of Akumuli for customers who want reliability engineering for Windows platform in data center or cloud of their choice.

Lazin commented 6 years ago

Yep. I can mention it in the next post. It will be about new Grafana plugin and other integrations could be included as well. Waiting for Grafana guys to add my plugin to the repository.

dmitrios commented 6 years ago

This is what it looks like for metrics from Windows container running on Nano Server using Akumuli (database and grafana plugin):sonar-akumuli-02 Also, it would be helpful to have stable Docker image available. It appears that after 2-3 hours Akumuli cannot process large interval ( 3h or so) and after restart does not show 10 min back of collected series.

Lazin commented 6 years ago

What do you mean by that? It can't return 3hr of data? Does it happens only with docker?

Lazin commented 6 years ago

That docker image was contributed years ago. I'm updating only a deb repository (from CI environment, after every successful build of the master branch). Are you suggesting that the docker image should be maintained the same way?

dmitrios commented 6 years ago

Grafana, InfluxDb and Prometheus container images are regularly updated. Having image for stable version and another one for master (like Grafana does) would be helpful to easily update Akumuli and keep its data volume. The symptom I encountered with Docker image I built from latest was running Akumuli in Docker for 5 hours before query timeout with error in the Akumuli container log. After the restarting Akumuli container, query for average CPU did not show collected data for 10 min back from container restart but data before then was intact. If I can reproduce it again, I'll create a bug.

Lazin commented 6 years ago

OK, it looks like I have to learn Docker (finally) :) About this symptom. I'm always running VMs with Akumuli and data collectors and never encountered anything like this. Maybe it's something Docker-related? Maybe the OverlayFS is the reason? The testing happens on TravisCI thus the tests are running within a Docker container, but testing takes less than 5 hours. Anyway, I'll try to reproduce it somehow.

dmitrios commented 6 years ago

If you need help with Docker, let me know. No issues building container on Ubuntu and then deploying it on Docker ( Mac) and Kubernetes. The container image is on "dmitrio/experimental" on Docker hub, built 4 days ago. I would suggest sending 20+ series with 32 metrics each ( 3+ tags) every 10 seconds and checking response time for query API every 15sec at the same time. With Docker container above you will see constant 3.5-4% CPU no matter if Akumuli receiving data or not, so I wonder why. Same data for InfluxDb has near zero CPU with spikes up to 15%, but that is given because they likely need to compress WAL.

dmitrios commented 6 years ago

I think I was able to repro it. Below is the log. Same query is running in Grafana when Akumuli restarts. The error is "Can't open next iterator because not found"

08535Z "range":

03T05:29:56.385215787Z {

03T05:29:56.385222728Z "from": "20171203T045954.156",

03T05:29:56.385229899Z "to": "20171203T052954.156"

03T05:29:56.385237320Z },

03T05:29:56.385244673Z "order-by": "series",

03T05:29:56.385270331Z "apply": ""

03T05:29:56.385303153Z }

03T05:29:56.385311783Z

03T05:29:56.385318297Z 2017-12-03 05:29:56,382 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365449088 done

03T05:29:56.385325899Z 2017-12-03 05:29:56,382 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365449088 destroyed

03T05:29:56.385333002Z 2017-12-03 05:29:56,382 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.385340477Z 2017-12-03 05:29:56,383 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.385347767Z 2017-12-03 05:29:56,383 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.385355518Z 2017-12-03 05:29:56,383 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.385363685Z 2017-12-03 05:29:56,383 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.386030754Z 2017-12-03 05:29:56,385 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678164123184 done

03T05:29:56.386059753Z 2017-12-03 05:29:56,385 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678164123184 destroyed

03T05:29:56.396739964Z 2017-12-03 05:29:56,396 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.402532990Z 2017-12-03 05:29:56,402 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:29:56.402591143Z 2017-12-03 05:29:56,402 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:29:56.402943025Z 2017-12-03 05:29:56,402 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 created

03T05:29:56.403308485Z 2017-12-03 05:29:56,403 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 started

03T05:29:56.409164922Z 2017-12-03 05:29:56,408 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:29:56.410772270Z 2017-12-03 05:29:56,409 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:29:56.411142588Z "group-aggregate":

03T05:29:56.411580529Z {

03T05:29:56.411599011Z "metric": "innodb_metrics_sonar_scrape_duration_milliseconds",

03T05:29:56.411971316Z "step": "1s",

03T05:29:56.412730228Z "func":

03T05:29:56.412746597Z [

03T05:29:56.413506560Z "mean"

03T05:29:56.414374733Z ]

03T05:29:56.414680396Z },

03T05:29:56.414922323Z "range":

03T05:29:56.415186777Z {

03T05:29:56.415450461Z "from": "20171203T045954.156",

03T05:29:56.415807376Z "to": "20171203T052954.156"

03T05:29:56.416200360Z },

03T05:29:56.416848461Z "order-by": "series",

03T05:29:56.417193504Z "apply": ""

03T05:29:56.417382820Z }

03T05:29:56.417423762Z

03T05:29:56.417650650Z 2017-12-03 05:29:56,415 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.420612736Z 2017-12-03 05:29:56,420 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:29:56.420876102Z 2017-12-03 05:29:56,420 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:29:56.420891580Z "group-aggregate":

03T05:29:56.421043541Z {

03T05:29:56.421059278Z "metric": "mssql_perf_stats_sonar_scrape_duration_milliseconds",

03T05:29:56.421251456Z "step": "1s",

03T05:29:56.421266180Z "func":

03T05:29:56.421275047Z [

03T05:29:56.421436282Z "mean"

03T05:29:56.421449738Z ]

03T05:29:56.421459652Z },

03T05:29:56.421617208Z "range":

03T05:29:56.421630962Z {

03T05:29:56.421783462Z "from": "20171203T045954.156",

03T05:29:56.421797600Z "to": "20171203T052954.156"

03T05:29:56.421979688Z },

03T05:29:56.421993574Z "order-by": "series",

03T05:29:56.422003569Z "apply": ""

03T05:29:56.422154918Z }

03T05:29:56.422169679Z

03T05:29:56.422324836Z 2017-12-03 05:29:56,420 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.422495828Z 2017-12-03 05:29:56,422 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.423363595Z 2017-12-03 05:29:56,422 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.424210370Z 2017-12-03 05:29:56,423 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365449056 done

03T05:29:56.424294994Z 2017-12-03 05:29:56,423 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365449056 destroyed

03T05:29:56.425629849Z 2017-12-03 05:29:56,423 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902519816 created

03T05:29:56.427271632Z 2017-12-03 05:29:56,425 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902519816 started

03T05:29:56.427586211Z 2017-12-03 05:29:56,426 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969465344 done

03T05:29:56.428059016Z 2017-12-03 05:29:56,427 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969465344 destroyed

03T05:29:56.433730418Z 2017-12-03 05:29:56,433 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768139776 done

03T05:29:56.439202414Z 2017-12-03 05:29:56,438 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:29:56.439262476Z 2017-12-03 05:29:56,438 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:29:56.439272702Z "group-aggregate":

03T05:29:56.439277445Z {

03T05:29:56.439281847Z "metric": "mssql_perf_stats_sonar_scrape_duration_milliseconds",

03T05:29:56.439286197Z "step": "1s",

03T05:29:56.439290094Z "func":

03T05:29:56.439293944Z [

03T05:29:56.439297688Z "mean"

03T05:29:56.439578881Z ]

03T05:29:56.439593462Z },

03T05:29:56.439603021Z "range":

03T05:29:56.439625843Z {

03T05:29:56.439635809Z "from": "20171203T045954.156",

03T05:29:56.439644991Z "to": "20171203T052954.156"

03T05:29:56.439653872Z },

03T05:29:56.439662554Z "order-by": "series",

03T05:29:56.439670513Z "apply": ""

03T05:29:56.439678057Z }

03T05:29:56.439686274Z

03T05:29:56.440182614Z 2017-12-03 05:29:56,439 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678432558640 done

03T05:29:56.440205750Z 2017-12-03 05:29:56,439 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768139776 destroyed

03T05:29:56.440215913Z 2017-12-03 05:29:56,439 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678432558640 destroyed

03T05:29:56.442536301Z 2017-12-03 05:29:56,442 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:29:56.445165306Z 2017-12-03 05:29:56,444 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340912 done

03T05:29:56.446140210Z 2017-12-03 05:29:56,445 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340912 destroyed

03T05:29:56.838313140Z 2017-12-03 05:29:56,835 tcp-session-81 [INFO] /Akumuli/akumulid/logger.cpp(16) Session created

03T05:29:56.838655981Z 2017-12-03 05:29:56,838 resp-protocol-parser [INFO] /Akumuli/akumulid/logger.cpp(16) Starting protocol parser

03T05:29:56.838685259Z 2017-12-03 05:29:56,837 tcp-session-80 [ERROR] /Akumuli/akumulid/logger.cpp(19) End of file

03T05:29:56.838963817Z 2017-12-03 05:29:56,838 tcp-session-80 [INFO] /Akumuli/akumulid/logger.cpp(16) Session destroyed

03T05:29:56.843541383Z 2017-12-03 05:29:56,843 tcp-session-82 [INFO] /Akumuli/akumulid/logger.cpp(16) Session created

03T05:29:56.843601313Z 2017-12-03 05:29:56,843 resp-protocol-parser [INFO] /Akumuli/akumulid/logger.cpp(16) Starting protocol parser

03T05:29:56.843892667Z 2017-12-03 05:29:56,843 tcp-session-83 [INFO] /Akumuli/akumulid/logger.cpp(16) Session created

03T05:29:56.843910226Z 2017-12-03 05:29:56,843 resp-protocol-parser [INFO] /Akumuli/akumulid/logger.cpp(16) Starting protocol parser

03T05:29:56.849615870Z 2017-12-03 05:29:56,849 tcp-session-82 [ERROR] /Akumuli/akumulid/logger.cpp(19) End of file

03T05:29:56.849970044Z 2017-12-03 05:29:56,849 tcp-session-82 [INFO] /Akumuli/akumulid/logger.cpp(16) Session destroyed

03T05:29:56.851922675Z 2017-12-03 05:29:56,851 tcp-session-81 [ERROR] /Akumuli/akumulid/logger.cpp(19) End of file

03T05:29:56.852005963Z 2017-12-03 05:29:56,851 tcp-session-81 [INFO] /Akumuli/akumulid/logger.cpp(16) Session destroyed

03T05:29:56.854099270Z 2017-12-03 05:29:56,853 tcp-session-84 [INFO] /Akumuli/akumulid/logger.cpp(16) Session created

03T05:29:56.854133649Z 2017-12-03 05:29:56,853 resp-protocol-parser [INFO] /Akumuli/akumulid/logger.cpp(16) Starting protocol parser

03T05:29:56.855077512Z 2017-12-03 05:29:56,854 tcp-session-83 [ERROR] /Akumuli/akumulid/logger.cpp(19) End of file

03T05:29:56.855333367Z 2017-12-03 05:29:56,855 tcp-session-83 [INFO] /Akumuli/akumulid/logger.cpp(16) Session destroyed

03T05:30:00.018930553Z 2017-12-03 05:30:00,018 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:30:00.018977506Z 2017-12-03 05:30:00,018 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:30:00.019177381Z 2017-12-03 05:30:00,018 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 created

03T05:30:00.019420074Z 2017-12-03 05:30:00,019 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 started

03T05:30:00.030067348Z 2017-12-03 05:30:00,027 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.030478761Z 2017-12-03 05:30:00,030 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.030498595Z "group-aggregate":

03T05:30:00.030508649Z {

03T05:30:00.030517414Z "metric": "mssql_perf_stats_Transactionssec_cntr_value",

03T05:30:00.030546757Z "step": "5s",

03T05:30:00.030807911Z "func":

03T05:30:00.031020945Z [

03T05:30:00.031036673Z "mean"

03T05:30:00.031046239Z ]

03T05:30:00.031355394Z },

03T05:30:00.031371510Z "range":

03T05:30:00.031379539Z {

03T05:30:00.031386455Z "from": "20171203T042958.333",

03T05:30:00.031393348Z "to": "20171203T052958.333"

03T05:30:00.031418615Z },

03T05:30:00.031427338Z "order-by": "series",

03T05:30:00.031754627Z "apply":

03T05:30:00.031772947Z [

03T05:30:00.031782661Z {

03T05:30:00.031790453Z "name": "rate"

03T05:30:00.031819035Z }

03T05:30:00.031833691Z ]

03T05:30:00.032326972Z }

03T05:30:00.033191397Z

03T05:30:00.036046772Z 2017-12-03 05:30:00,035 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.036103702Z 2017-12-03 05:30:00,035 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.036114211Z 2017-12-03 05:30:00,035 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 created

03T05:30:00.036122229Z 2017-12-03 05:30:00,035 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 started

03T05:30:00.038578081Z 2017-12-03 05:30:00,038 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969464592 done

03T05:30:00.038934519Z 2017-12-03 05:30:00,038 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969464592 destroyed

03T05:30:00.040442479Z 2017-12-03 05:30:00,039 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320152 created

03T05:30:00.040480612Z 2017-12-03 05:30:00,039 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320152 started

03T05:30:00.042797138Z 2017-12-03 05:30:00,040 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:30:00.044594319Z 2017-12-03 05:30:00,043 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902485832 created

03T05:30:00.044632039Z 2017-12-03 05:30:00,043 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902485832 started

03T05:30:00.049576432Z 2017-12-03 05:30:00,049 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365448928 done

03T05:30:00.049993359Z 2017-12-03 05:30:00,049 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365448928 destroyed

03T05:30:00.054557757Z 2017-12-03 05:30:00,053 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.057254753Z 2017-12-03 05:30:00,056 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:30:00.057302030Z 2017-12-03 05:30:00,056 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:30:00.060860233Z 2017-12-03 05:30:00,060 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.060903893Z "group-aggregate":

03T05:30:00.060916079Z {

03T05:30:00.060928699Z "metric": "mssql_wait_stats_PAGEIOLATCH_wait_time_ms",

03T05:30:00.060937466Z "step": "2s",

03T05:30:00.060963730Z "func":

03T05:30:00.060973385Z [

03T05:30:00.060979882Z "mean"

03T05:30:00.060986849Z ]

03T05:30:00.060993203Z },

03T05:30:00.061000319Z "range":

03T05:30:00.061007734Z {

03T05:30:00.061014779Z "from": "20171203T042958.339",

03T05:30:00.061028442Z "to": "20171203T052958.339"

03T05:30:00.061036980Z },

03T05:30:00.061044021Z "order-by": "series",

03T05:30:00.061051539Z "apply": ""

03T05:30:00.061058256Z }

03T05:30:00.061065565Z

03T05:30:00.061072217Z 2017-12-03 05:30:00,059 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.061695722Z 2017-12-03 05:30:00,061 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.062619196Z 2017-12-03 05:30:00,061 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.062689137Z "group-aggregate":

03T05:30:00.062728553Z {

03T05:30:00.062925717Z "metric": "mssql_wait_stats_THREADPOOL_wait_time_ms",

03T05:30:00.062949037Z "step": "2s",

03T05:30:00.062960490Z "func":

03T05:30:00.062969502Z [

03T05:30:00.062977924Z "mean"

03T05:30:00.062985885Z ]

03T05:30:00.062993661Z },

03T05:30:00.063001619Z "range":

03T05:30:00.063009383Z {

03T05:30:00.063059392Z "from": "20171203T042958.339",

03T05:30:00.063073652Z "to": "20171203T052958.339"

03T05:30:00.063083177Z },

03T05:30:00.063091051Z "order-by": "series",

03T05:30:00.063098263Z "apply": ""

03T05:30:00.063107130Z }

03T05:30:00.063116474Z

03T05:30:00.064836402Z 2017-12-03 05:30:00,064 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.064877322Z "group-aggregate":

03T05:30:00.064890029Z {

03T05:30:00.064899946Z "metric": "mssql_perf_stats_Batch_Requestssec_cntr_value",

03T05:30:00.064908025Z "step": "5s",

03T05:30:00.064967529Z "func":

03T05:30:00.064981423Z [

03T05:30:00.065013150Z "mean"

03T05:30:00.065022402Z ]

03T05:30:00.065029815Z },

03T05:30:00.065036637Z "range":

03T05:30:00.065044676Z {

03T05:30:00.065051806Z "from": "20171203T042958.339",

03T05:30:00.065060221Z "to": "20171203T052958.339"

03T05:30:00.065068064Z },

03T05:30:00.065075760Z "order-by": "series",

03T05:30:00.065084232Z "apply":

03T05:30:00.065092427Z [

03T05:30:00.065100679Z {

03T05:30:00.065110308Z "name": "rate"

03T05:30:00.065120512Z }

03T05:30:00.065129093Z ]

03T05:30:00.065137260Z }

03T05:30:00.065146019Z

03T05:30:00.070311018Z 2017-12-03 05:30:00,069 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.074751229Z 2017-12-03 05:30:00,072 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.075513763Z "group-aggregate":

03T05:30:00.075811300Z {

03T05:30:00.075833993Z "metric": "mssql_wait_stats_MEMORY_ALLOCATION_EXT_max_wait_time_ms",

03T05:30:00.075844069Z "step": "2s",

03T05:30:00.075987314Z "func":

03T05:30:00.076141011Z [

03T05:30:00.076161183Z "mean"

03T05:30:00.076319859Z ]

03T05:30:00.076333968Z },

03T05:30:00.076468549Z "range":

03T05:30:00.076632800Z {

03T05:30:00.076646671Z "from": "20171203T042958.339",

03T05:30:00.076815304Z "to": "20171203T052958.339"

03T05:30:00.076832119Z },

03T05:30:00.077038427Z "order-by": "series",

03T05:30:00.077070433Z "apply": ""

03T05:30:00.077231869Z }

03T05:30:00.077247290Z

03T05:30:00.077482421Z 2017-12-03 05:30:00,077 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340672 done

03T05:30:00.078330476Z 2017-12-03 05:30:00,073 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.078690807Z 2017-12-03 05:30:00,078 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.078710803Z "group-aggregate":

03T05:30:00.078720020Z {

03T05:30:00.078745786Z "metric": "mssql_wait_stats_STARTUP_DEPENDENCY_MANAGER_wait_time_ms",

03T05:30:00.078753978Z "step": "2s",

03T05:30:00.078760230Z "func":

03T05:30:00.078767192Z [

03T05:30:00.078773962Z "mean"

03T05:30:00.078781173Z ]

03T05:30:00.078795166Z },

03T05:30:00.078803623Z "range":

03T05:30:00.078811621Z {

03T05:30:00.078819276Z "from": "20171203T042958.339",

03T05:30:00.078827990Z "to": "20171203T052958.339"

03T05:30:00.078836063Z },

03T05:30:00.078843415Z "order-by": "series",

03T05:30:00.078850588Z "apply": ""

03T05:30:00.078857561Z }

03T05:30:00.078864938Z

03T05:30:00.083184974Z 2017-12-03 05:30:00,075 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 created

03T05:30:00.084630897Z 2017-12-03 05:30:00,075 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678432592992 done

03T05:30:00.084664142Z 2017-12-03 05:30:00,083 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678432592992 destroyed

03T05:30:00.084674129Z 2017-12-03 05:30:00,078 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340672 destroyed

03T05:30:00.086693955Z 2017-12-03 05:30:00,084 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 started

03T05:30:00.092330911Z 2017-12-03 05:30:00,086 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633886400 done

03T05:30:00.092499793Z 2017-12-03 05:30:00,090 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633886400 destroyed

03T05:30:00.097466310Z 2017-12-03 05:30:00,094 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768139696 done

03T05:30:00.098109960Z 2017-12-03 05:30:00,096 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768139696 destroyed

03T05:30:00.106639890Z 2017-12-03 05:30:00,105 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 created

03T05:30:00.107281223Z 2017-12-03 05:30:00,106 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 started

03T05:30:00.113416225Z 2017-12-03 05:30:00,112 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.115198714Z 2017-12-03 05:30:00,114 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.115533796Z "group-aggregate":

03T05:30:00.115782435Z {

03T05:30:00.115957564Z "metric": "mssql_wait_stats_WRITELOG_wait_time_ms",

03T05:30:00.115973075Z "step": "2s",

03T05:30:00.116087640Z "func":

03T05:30:00.116277734Z [

03T05:30:00.116380783Z "mean"

03T05:30:00.117084248Z ]

03T05:30:00.117101640Z },

03T05:30:00.117510905Z "range":

03T05:30:00.117527555Z {

03T05:30:00.117731694Z "from": "20171203T042958.339",

03T05:30:00.117949568Z "to": "20171203T052958.339"

03T05:30:00.117964837Z },

03T05:30:00.118147023Z "order-by": "series",

03T05:30:00.118164467Z "apply": ""

03T05:30:00.118360471Z }

03T05:30:00.118375585Z

03T05:30:00.118709004Z 2017-12-03 05:30:00,118 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452400 done

03T05:30:00.118726883Z 2017-12-03 05:30:00,118 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452400 destroyed

03T05:30:00.123100110Z 2017-12-03 05:30:00,122 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:30:00.123142925Z 2017-12-03 05:30:00,122 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:30:00.128626735Z 2017-12-03 05:30:00,128 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.128667748Z 2017-12-03 05:30:00,128 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.135769387Z 2017-12-03 05:30:00,134 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969465424 done

03T05:30:00.136317618Z 2017-12-03 05:30:00,135 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.136333919Z 2017-12-03 05:30:00,135 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.136339203Z "group-aggregate":

03T05:30:00.136343642Z {

03T05:30:00.136347688Z "metric": "mssql_perf_stats_Transactionssec_cntr_value",

03T05:30:00.136351971Z "step": "5s",

03T05:30:00.136355951Z "func":

03T05:30:00.136359834Z [

03T05:30:00.136363618Z "mean"

03T05:30:00.136367450Z ]

03T05:30:00.136466004Z },

03T05:30:00.136488829Z "range":

03T05:30:00.136498003Z {

03T05:30:00.136555838Z "from": "20171203T042958.340",

03T05:30:00.136561137Z "to": "20171203T052958.340"

03T05:30:00.136565187Z },

03T05:30:00.136569102Z "order-by": "series",

03T05:30:00.136585731Z "apply":

03T05:30:00.136590032Z [

03T05:30:00.136593609Z {

03T05:30:00.136597114Z "name": "rate"

03T05:30:00.136600822Z }

03T05:30:00.136604380Z ]

03T05:30:00.136634126Z }

03T05:30:00.136656317Z

03T05:30:00.138851767Z 2017-12-03 05:30:00,137 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:30:00.140367888Z 2017-12-03 05:30:00,139 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340736 done

03T05:30:00.142248395Z 2017-12-03 05:30:00,141 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969465424 destroyed

03T05:30:00.144321430Z 2017-12-03 05:30:00,142 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340736 destroyed

03T05:30:00.144539673Z 2017-12-03 05:30:00,143 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.144554872Z 2017-12-03 05:30:00,143 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.145425510Z 2017-12-03 05:30:00,144 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.145520757Z 2017-12-03 05:30:00,145 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.145553463Z "group-aggregate":

03T05:30:00.145561129Z {

03T05:30:00.145569044Z "metric": "mssql_wait_stats_WRITELOG_waiting_tasks_count",

03T05:30:00.145573865Z "step": "5s",

03T05:30:00.145585959Z "func":

03T05:30:00.145612952Z [

03T05:30:00.146707718Z "mean"

03T05:30:00.146737098Z ]

03T05:30:00.148927787Z },

03T05:30:00.148957685Z "range":

03T05:30:00.148962757Z {

03T05:30:00.149411829Z "from": "20171203T042958.340",

03T05:30:00.150680137Z "to": "20171203T052958.340"

03T05:30:00.151963179Z },

03T05:30:00.152577483Z "order-by": "series",

03T05:30:00.153040129Z "apply":

03T05:30:00.154413354Z [

03T05:30:00.155140898Z {

03T05:30:00.155161083Z "name": "rate"

03T05:30:00.155167315Z }

03T05:30:00.155171250Z ]

03T05:30:00.155274047Z }

03T05:30:00.155286327Z

03T05:30:00.156223603Z 2017-12-03 05:30:00,155 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 created

03T05:30:00.156593670Z 2017-12-03 05:30:00,145 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320584 created

03T05:30:00.156612966Z 2017-12-03 05:30:00,156 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320584 started

03T05:30:00.157379283Z 2017-12-03 05:30:00,157 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 started

03T05:30:00.160891453Z 2017-12-03 05:30:00,160 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.160928818Z 2017-12-03 05:30:00,160 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.160938416Z "group-aggregate":

03T05:30:00.160946323Z {

03T05:30:00.160954042Z "metric": "mssql_perf_stats_Write_Transactionssec_cntr_value",

03T05:30:00.160962150Z "step": "5s",

03T05:30:00.160969958Z "func":

03T05:30:00.160977716Z [

03T05:30:00.160985361Z "mean"

03T05:30:00.160992654Z ]

03T05:30:00.160999749Z },

03T05:30:00.161007244Z "range":

03T05:30:00.161014804Z {

03T05:30:00.161021756Z "from": "20171203T042958.340",

03T05:30:00.161029265Z "to": "20171203T052958.340"

03T05:30:00.161037082Z },

03T05:30:00.161044182Z "order-by": "series",

03T05:30:00.161051774Z "apply":

03T05:30:00.161058967Z [

03T05:30:00.161066247Z {

03T05:30:00.161073406Z "name": "rate"

03T05:30:00.161080599Z }

03T05:30:00.161087608Z ]

03T05:30:00.161094908Z }

03T05:30:00.161102324Z

03T05:30:00.163329767Z 2017-12-03 05:30:00,162 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.164103557Z 2017-12-03 05:30:00,163 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.164125062Z "group-aggregate":

03T05:30:00.164129795Z {

03T05:30:00.164273956Z "metric": "mssql_perf_stats_Memory_broker_clerk_size_cntr_value",

03T05:30:00.164284458Z "step": "5s",

03T05:30:00.164288793Z "func":

03T05:30:00.164292671Z [

03T05:30:00.164421647Z "mean"

03T05:30:00.164445755Z ]

03T05:30:00.164450529Z },

03T05:30:00.164456141Z "range":

03T05:30:00.164577224Z {

03T05:30:00.164587680Z "from": "20171203T042958.339",

03T05:30:00.164593413Z "to": "20171203T052958.339"

03T05:30:00.164732732Z },

03T05:30:00.164743276Z "order-by": "series",

03T05:30:00.164750091Z "apply": ""

03T05:30:00.164880639Z }

03T05:30:00.164893899Z

03T05:30:00.165037464Z 2017-12-03 05:30:00,164 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678432592240 done

03T05:30:00.165054368Z 2017-12-03 05:30:00,163 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.165846270Z 2017-12-03 05:30:00,165 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.166339081Z "group-aggregate":

03T05:30:00.166649393Z {

03T05:30:00.166810848Z "metric": "mssql_perf_stats_Lock_Timeoutssec_cntr_value",

03T05:30:00.166825694Z "step": "5s",

03T05:30:00.166834941Z "func":

03T05:30:00.167034003Z [

03T05:30:00.167259109Z "mean"

03T05:30:00.167275524Z ]

03T05:30:00.167496918Z },

03T05:30:00.167510578Z "range":

03T05:30:00.167783831Z {

03T05:30:00.167794457Z "from": "20171203T042958.340",

03T05:30:00.168020721Z "to": "20171203T052958.340"

03T05:30:00.168032937Z },

03T05:30:00.168327874Z "order-by": "series",

03T05:30:00.168355171Z "apply":

03T05:30:00.168601894Z [

03T05:30:00.168613801Z {

03T05:30:00.168850230Z "name": "rate"

03T05:30:00.168862176Z }

03T05:30:00.168866509Z ]

03T05:30:00.168870407Z }

03T05:30:00.168874190Z

03T05:30:00.170857269Z 2017-12-03 05:30:00,165 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678432592240 destroyed

03T05:30:00.172302398Z 2017-12-03 05:30:00,171 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892304 done

03T05:30:00.172866818Z 2017-12-03 05:30:00,172 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892304 destroyed

03T05:30:00.177174209Z 2017-12-03 05:30:00,176 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320152 created

03T05:30:00.179112157Z 2017-12-03 05:30:00,178 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320152 started

03T05:30:00.181256855Z 2017-12-03 05:30:00,180 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.181542762Z 2017-12-03 05:30:00,180 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969464720 done

03T05:30:00.181840671Z 2017-12-03 05:30:00,181 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969464720 destroyed

03T05:30:00.182392783Z 2017-12-03 05:30:00,182 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.182605698Z "group-aggregate":

03T05:30:00.182765877Z {

03T05:30:00.183263141Z "metric": "mssql_perf_stats_Log_Flushessec_cntr_value",

03T05:30:00.184072679Z "step": "5s",

03T05:30:00.184290946Z "func":

03T05:30:00.184407994Z [

03T05:30:00.184558894Z "mean"

03T05:30:00.184886092Z ]

03T05:30:00.185119022Z },

03T05:30:00.185132704Z "range":

03T05:30:00.185696252Z {

03T05:30:00.187014583Z "from": "20171203T042958.340",

03T05:30:00.187212517Z "to": "20171203T052958.340"

03T05:30:00.187228063Z },

03T05:30:00.187399748Z "order-by": "series",

03T05:30:00.187725655Z "apply":

03T05:30:00.187960408Z [

03T05:30:00.188698912Z {

03T05:30:00.188714985Z "name": "rate"

03T05:30:00.189072262Z }

03T05:30:00.189087446Z ]

03T05:30:00.189387922Z }

03T05:30:00.189926352Z

03T05:30:00.194109573Z 2017-12-03 05:30:00,191 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320584 created

03T05:30:00.201017688Z 2017-12-03 05:30:00,200 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320584 started

03T05:30:00.201190322Z 2017-12-03 05:30:00,198 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 created

03T05:30:00.201331591Z 2017-12-03 05:30:00,200 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 created

03T05:30:00.201342573Z 2017-12-03 05:30:00,201 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 started

03T05:30:00.201921996Z 2017-12-03 05:30:00,200 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298378976 done

03T05:30:00.203289180Z 2017-12-03 05:30:00,202 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298378976 destroyed

03T05:30:00.203560379Z 2017-12-03 05:30:00,195 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.203762633Z 2017-12-03 05:30:00,201 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 started

03T05:30:00.206121262Z 2017-12-03 05:30:00,204 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.206167611Z "group-aggregate":

03T05:30:00.206201846Z {

03T05:30:00.206219864Z "metric": "mssql_perf_stats_Log_Flush_Wait_Time_cntr_value",

03T05:30:00.206230907Z "step": "5s",

03T05:30:00.206240604Z "func":

03T05:30:00.206248005Z [

03T05:30:00.206254440Z "mean"

03T05:30:00.206260517Z ]

03T05:30:00.206267608Z },

03T05:30:00.206305064Z "range":

03T05:30:00.206315119Z {

03T05:30:00.206319777Z "from": "20171203T042958.340",

03T05:30:00.206323764Z "to": "20171203T052958.340"

03T05:30:00.206327931Z },

03T05:30:00.206331579Z "order-by": "series",

03T05:30:00.206335612Z "apply":

03T05:30:00.206781961Z [

03T05:30:00.206799775Z {

03T05:30:00.206906812Z "name": "rate"

03T05:30:00.207044545Z }

03T05:30:00.207057287Z ]

03T05:30:00.207180774Z }

03T05:30:00.207192218Z

03T05:30:00.215067325Z 2017-12-03 05:30:00,202 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.215873104Z 2017-12-03 05:30:00,215 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.215893569Z "group-aggregate":

03T05:30:00.215898803Z {

03T05:30:00.216057228Z "metric": "mssql_perf_stats_Lock_Waitssec_cntr_value",

03T05:30:00.216068335Z "step": "5s",

03T05:30:00.216199726Z "func":

03T05:30:00.216211141Z [

03T05:30:00.216218029Z "mean"

03T05:30:00.216348913Z ]

03T05:30:00.216360227Z },

03T05:30:00.216366710Z "range":

03T05:30:00.216509372Z {

03T05:30:00.216520045Z "from": "20171203T042958.340",

03T05:30:00.216676439Z "to": "20171203T052958.340"

03T05:30:00.216699604Z },

03T05:30:00.216833889Z "order-by": "series",

03T05:30:00.216842565Z "apply":

03T05:30:00.216846638Z [

03T05:30:00.216850515Z {

03T05:30:00.216983404Z "name": "rate"

03T05:30:00.216995642Z }

03T05:30:00.217003053Z ]

03T05:30:00.217009949Z }

03T05:30:00.217184251Z

03T05:30:00.217347425Z 2017-12-03 05:30:00,215 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.217361435Z 2017-12-03 05:30:00,217 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.218222162Z 2017-12-03 05:30:00,200 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452368 done

03T05:30:00.220221377Z 2017-12-03 05:30:00,219 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452368 destroyed

03T05:30:00.224069022Z 2017-12-03 05:30:00,223 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678700995104 done

03T05:30:00.225096061Z 2017-12-03 05:30:00,224 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678700995104 destroyed

03T05:30:00.227350056Z 2017-12-03 05:30:00,226 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.228008739Z 2017-12-03 05:30:00,227 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.228402085Z "group-aggregate":

03T05:30:00.228586011Z {

03T05:30:00.228601941Z "metric": "mssql_perf_stats_Latch_Waitssec_cntr_value",

03T05:30:00.228835306Z "step": "5s",

03T05:30:00.228849802Z "func":

03T05:30:00.229082403Z [

03T05:30:00.229099781Z "mean"

03T05:30:00.229110964Z ]

03T05:30:00.229303113Z },

03T05:30:00.229466133Z "range":

03T05:30:00.229656291Z {

03T05:30:00.230176958Z "from": "20171203T042958.340",

03T05:30:00.230200576Z "to": "20171203T052958.340"

03T05:30:00.230210091Z },

03T05:30:00.230217686Z "order-by": "series",

03T05:30:00.230400727Z "apply":

03T05:30:00.230614194Z [

03T05:30:00.230901408Z {

03T05:30:00.230919717Z "name": "rate"

03T05:30:00.231087181Z }

03T05:30:00.231106788Z ]

03T05:30:00.231542871Z }

03T05:30:00.231584480Z

03T05:30:00.232507032Z 2017-12-03 05:30:00,228 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678432594960 done

03T05:30:00.234097547Z 2017-12-03 05:30:00,233 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678432594960 destroyed

03T05:30:00.239777235Z 2017-12-03 05:30:00,238 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.242901351Z 2017-12-03 05:30:00,242 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.243448952Z "group-aggregate":

03T05:30:00.243488624Z {

03T05:30:00.244124187Z "metric": "mssql_perf_stats_Batch_Requestssec_cntr_value",

03T05:30:00.244508707Z "step": "5s",

03T05:30:00.244545294Z "func":

03T05:30:00.244585104Z [

03T05:30:00.245144567Z "mean"

03T05:30:00.245189744Z ]

03T05:30:00.245621863Z },

03T05:30:00.245652109Z "range":

03T05:30:00.246772767Z {

03T05:30:00.246805000Z "from": "20171203T042958.340",

03T05:30:00.247017100Z "to": "20171203T052958.340"

03T05:30:00.247413023Z },

03T05:30:00.247431755Z "order-by": "series",

03T05:30:00.247442124Z "apply":

03T05:30:00.247451231Z [

03T05:30:00.247757874Z {

03T05:30:00.247778259Z "name": "rate"

03T05:30:00.247783090Z }

03T05:30:00.247787144Z ]

03T05:30:00.247790940Z }

03T05:30:00.247794593Z

03T05:30:00.248713427Z 2017-12-03 05:30:00,247 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320152 created

03T05:30:00.249491815Z 2017-12-03 05:30:00,248 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320152 started

03T05:30:00.258310002Z 2017-12-03 05:30:00,257 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.260299169Z 2017-12-03 05:30:00,258 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.260358722Z "group-aggregate":

03T05:30:00.260664089Z {

03T05:30:00.261554019Z "metric": "mssql_perf_stats_Number_of_Deadlockssec_cntr_value",

03T05:30:00.262132168Z "step": "5s",

03T05:30:00.262251770Z "func":

03T05:30:00.262262876Z [

03T05:30:00.262606269Z "mean"

03T05:30:00.263318992Z ]

03T05:30:00.263360212Z },

03T05:30:00.263370244Z "range":

03T05:30:00.263378622Z {

03T05:30:00.263401781Z "from": "20171203T042958.340",

03T05:30:00.263410320Z "to": "20171203T052958.340"

03T05:30:00.263416664Z },

03T05:30:00.263422321Z "order-by": "series",

03T05:30:00.263585325Z "apply":

03T05:30:00.263830708Z [

03T05:30:00.263989735Z {

03T05:30:00.264016392Z "name": "rate"

03T05:30:00.264329285Z }

03T05:30:00.264448752Z ]

03T05:30:00.264463876Z }

03T05:30:00.264473357Z

03T05:30:00.266175370Z 2017-12-03 05:30:00,259 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.266387094Z 2017-12-03 05:30:00,266 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.266403538Z "group-aggregate":

03T05:30:00.266413984Z {

03T05:30:00.266438287Z "metric": "mssql_perf_stats_SQL_Compilationssec_cntr_value",

03T05:30:00.266448980Z "step": "5s",

03T05:30:00.266462228Z "func":

03T05:30:00.266470473Z [

03T05:30:00.266478982Z "mean"

03T05:30:00.266487322Z ]

03T05:30:00.266494868Z },

03T05:30:00.266502267Z "range":

03T05:30:00.266510056Z {

03T05:30:00.266518050Z "from": "20171203T042958.340",

03T05:30:00.266526754Z "to": "20171203T052958.340"

03T05:30:00.266535024Z },

03T05:30:00.266542819Z "order-by": "series",

03T05:30:00.266557410Z "apply":

03T05:30:00.266564935Z [

03T05:30:00.266571685Z {

03T05:30:00.266579369Z "name": "rate"

03T05:30:00.266587322Z }

03T05:30:00.266595888Z ]

03T05:30:00.266711696Z }

03T05:30:00.266726147Z

03T05:30:00.270348675Z 2017-12-03 05:30:00,270 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:30:00.270383198Z 2017-12-03 05:30:00,270 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:30:00.272726626Z 2017-12-03 05:30:00,272 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340736 done

03T05:30:00.275608512Z 2017-12-03 05:30:00,274 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340736 destroyed

03T05:30:00.276275383Z 2017-12-03 05:30:00,275 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902485832 created

03T05:30:00.276579522Z 2017-12-03 05:30:00,276 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902485832 started

03T05:30:00.277634715Z 2017-12-03 05:30:00,276 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892096 done

03T05:30:00.280971840Z 2017-12-03 05:30:00,277 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892096 destroyed

03T05:30:00.288358251Z 2017-12-03 05:30:00,287 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678700996336 done

03T05:30:00.288959288Z 2017-12-03 05:30:00,288 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678700996336 destroyed

03T05:30:00.290108081Z 2017-12-03 05:30:00,289 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969466096 done

03T05:30:00.291843692Z 2017-12-03 05:30:00,290 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969466096 destroyed

03T05:30:00.291887567Z 2017-12-03 05:30:00,291 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.291897527Z 2017-12-03 05:30:00,291 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.291905270Z "group-aggregate":

03T05:30:00.291912461Z {

03T05:30:00.291919382Z "metric": "mssql_perf_stats_User_Connections_cntr_value",

03T05:30:00.291926255Z "step": "5s",

03T05:30:00.291933147Z "func":

03T05:30:00.291939932Z [

03T05:30:00.291946476Z "mean"

03T05:30:00.291953158Z ]

03T05:30:00.292436865Z },

03T05:30:00.292464327Z "range":

03T05:30:00.292476069Z {

03T05:30:00.294181803Z "from": "20171203T042958.340",

03T05:30:00.294245034Z "to": "20171203T052958.340"

03T05:30:00.294255960Z },

03T05:30:00.294263675Z "order-by": "series",

03T05:30:00.294273061Z "apply":

03T05:30:00.294280144Z [

03T05:30:00.294287145Z {

03T05:30:00.294295016Z "name": "rate"

03T05:30:00.294304565Z }

03T05:30:00.294315342Z ]

03T05:30:00.294322191Z }

03T05:30:00.294351292Z

03T05:30:00.299635155Z 2017-12-03 05:30:00,298 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.299719376Z 2017-12-03 05:30:00,299 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.299730982Z "group-aggregate":

03T05:30:00.299737375Z {

03T05:30:00.299744812Z "metric": "mssql_perf_stats_SQL_ReCompilationssec_cntr_value",

03T05:30:00.299749164Z "step": "5s",

03T05:30:00.299753240Z "func":

03T05:30:00.299757126Z [

03T05:30:00.299761055Z "mean"

03T05:30:00.299766302Z ]

03T05:30:00.299770233Z },

03T05:30:00.300786909Z "range":

03T05:30:00.300841174Z {

03T05:30:00.300853448Z "from": "20171203T042958.340",

03T05:30:00.300863371Z "to": "20171203T052958.340"

03T05:30:00.300871492Z },

03T05:30:00.300879677Z "order-by": "series",

03T05:30:00.300888124Z "apply":

03T05:30:00.300895364Z [

03T05:30:00.300901840Z {

03T05:30:00.300909255Z "name": "rate"

03T05:30:00.300917343Z }

03T05:30:00.300924426Z ]

03T05:30:00.300931728Z }

03T05:30:00.300938783Z

03T05:30:00.302992760Z 2017-12-03 05:30:00,302 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768139920 done

03T05:30:00.303417836Z 2017-12-03 05:30:00,303 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768139920 destroyed

03T05:30:00.309303011Z 2017-12-03 05:30:00,308 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320584 created

03T05:30:00.309361931Z 2017-12-03 05:30:00,309 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902320584 started

03T05:30:00.311175623Z 2017-12-03 05:30:00,310 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.311615060Z 2017-12-03 05:30:00,311 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.311770798Z "group-aggregate":

03T05:30:00.311799030Z {

03T05:30:00.311808229Z "metric": "mssql_perf_stats_Logoutssec_cntr_value",

03T05:30:00.311818179Z "step": "5s",

03T05:30:00.311827256Z "func":

03T05:30:00.312820688Z [

03T05:30:00.312848809Z "mean"

03T05:30:00.312877210Z ]

03T05:30:00.312886703Z },

03T05:30:00.312894763Z "range":

03T05:30:00.312902698Z {

03T05:30:00.312910967Z "from": "20171203T042958.340",

03T05:30:00.312919194Z "to": "20171203T052958.340"

03T05:30:00.312927635Z },

03T05:30:00.312935102Z "order-by": "series",

03T05:30:00.312944176Z "apply":

03T05:30:00.312952337Z [

03T05:30:00.312960021Z {

03T05:30:00.312968501Z "name": "rate"

03T05:30:00.315979115Z }

03T05:30:00.316065067Z ]

03T05:30:00.316080468Z }

03T05:30:00.316089616Z

03T05:30:00.317874395Z 2017-12-03 05:30:00,317 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452464 done

03T05:30:00.317906482Z 2017-12-03 05:30:00,317 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452464 destroyed

03T05:30:00.321838401Z 2017-12-03 05:30:00,321 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633890672 done

03T05:30:00.321869221Z 2017-12-03 05:30:00,321 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633890672 destroyed

03T05:30:00.334019380Z 2017-12-03 05:30:00,333 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:30:00.334074246Z 2017-12-03 05:30:00,333 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:30:00.338146198Z 2017-12-03 05:30:00,337 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.339057288Z 2017-12-03 05:30:00,338 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.339264639Z "group-aggregate":

03T05:30:00.339280187Z {

03T05:30:00.339480900Z "metric": "mssql_perf_stats_Loginssec_cntr_value",

03T05:30:00.339496002Z "step": "5s",

03T05:30:00.339505126Z "func":

03T05:30:00.339514135Z [

03T05:30:00.339522614Z "mean"

03T05:30:00.339530791Z ]

03T05:30:00.339547179Z },

03T05:30:00.339558100Z "range":

03T05:30:00.339566862Z {

03T05:30:00.339575242Z "from": "20171203T042958.340",

03T05:30:00.339811982Z "to": "20171203T052958.340"

03T05:30:00.339833999Z },

03T05:30:00.339863198Z "order-by": "series",

03T05:30:00.339871703Z "apply":

03T05:30:00.339878221Z [

03T05:30:00.340330750Z {

03T05:30:00.340366402Z "name": "rate"

03T05:30:00.340376885Z }

03T05:30:00.340384827Z ]

03T05:30:00.340393055Z }

03T05:30:00.340401620Z

03T05:30:00.346472695Z 2017-12-03 05:30:00,345 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452368 done

03T05:30:00.346505814Z 2017-12-03 05:30:00,346 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452368 destroyed

03T05:30:00.347209731Z 2017-12-03 05:30:00,346 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.347227358Z 2017-12-03 05:30:00,347 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.351882788Z 2017-12-03 05:30:00,350 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.352495257Z 2017-12-03 05:30:00,352 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.352515037Z "group-aggregate":

03T05:30:00.352526648Z {

03T05:30:00.352535911Z "metric": "mssql_perf_stats_Processes_blocked_cntr_value",

03T05:30:00.352583682Z "step": "5s",

03T05:30:00.352606475Z "func":

03T05:30:00.352791982Z [

03T05:30:00.352967894Z "mean"

03T05:30:00.352983568Z ]

03T05:30:00.352992651Z },

03T05:30:00.353516293Z "range":

03T05:30:00.353541065Z {

03T05:30:00.353613625Z "from": "20171203T042958.340",

03T05:30:00.353706912Z "to": "20171203T052958.340"

03T05:30:00.353717164Z },

03T05:30:00.354773227Z "order-by": "series",

03T05:30:00.354806713Z "apply": ""

03T05:30:00.354818775Z }

03T05:30:00.354827990Z

03T05:30:00.360261808Z 2017-12-03 05:30:00,359 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298378944 done

03T05:30:00.360295944Z 2017-12-03 05:30:00,359 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298378944 destroyed

03T05:30:00.369600885Z 2017-12-03 05:30:00,368 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.369642858Z 2017-12-03 05:30:00,369 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.375731163Z 2017-12-03 05:30:00,375 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:30:00.375779390Z 2017-12-03 05:30:00,375 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:30:00.376046245Z 2017-12-03 05:30:00,375 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.376212770Z 2017-12-03 05:30:00,376 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.376231453Z "group-aggregate":

03T05:30:00.376239333Z {

03T05:30:00.376381451Z "metric": "mssql_perf_stats_Page_life_expectancy_cntr_value",

03T05:30:00.376392195Z "step": "5s",

03T05:30:00.376397196Z "func":

03T05:30:00.376532066Z [

03T05:30:00.376683798Z "mean"

03T05:30:00.376694685Z ]

03T05:30:00.376698712Z },

03T05:30:00.376702882Z "range":

03T05:30:00.376812701Z {

03T05:30:00.376822955Z "from": "20171203T042958.340",

03T05:30:00.376961097Z "to": "20171203T052958.340"

03T05:30:00.376971245Z },

03T05:30:00.376975369Z "order-by": "series",

03T05:30:00.376979930Z "apply":

03T05:30:00.377133328Z [

03T05:30:00.377151797Z {

03T05:30:00.377163677Z "name": "rate"

03T05:30:00.377434769Z }

03T05:30:00.377450153Z ]

03T05:30:00.377685234Z }

03T05:30:00.377764047Z

03T05:30:00.380455758Z 2017-12-03 05:30:00,380 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:30:00.380834145Z 2017-12-03 05:30:00,380 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:30:00.383826841Z 2017-12-03 05:30:00,383 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340736 done

03T05:30:00.383866900Z 2017-12-03 05:30:00,383 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340736 destroyed

03T05:30:00.384116105Z 2017-12-03 05:30:00,383 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.385171540Z 2017-12-03 05:30:00,384 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.385203485Z "group-aggregate":

03T05:30:00.385214203Z {

03T05:30:00.385221380Z "metric": "mssql_perf_stats_Full_Scanssec_cntr_value",

03T05:30:00.385229380Z "step": "5s",

03T05:30:00.385251880Z "func":

03T05:30:00.385260418Z [

03T05:30:00.385576092Z "mean"

03T05:30:00.385657207Z ]

03T05:30:00.385712456Z },

03T05:30:00.385725989Z "range":

03T05:30:00.385734987Z {

03T05:30:00.386117988Z "from": "20171203T042958.340",

03T05:30:00.386130359Z "to": "20171203T052958.340"

03T05:30:00.386135543Z },

03T05:30:00.386316005Z "order-by": "series",

03T05:30:00.386334713Z "apply":

03T05:30:00.386343021Z [

03T05:30:00.386518643Z {

03T05:30:00.386532811Z "name": "rate"

03T05:30:00.386730845Z }

03T05:30:00.386792982Z ]

03T05:30:00.386803639Z }

03T05:30:00.386810638Z

03T05:30:00.390098309Z 2017-12-03 05:30:00,389 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.390138008Z 2017-12-03 05:30:00,389 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.400386473Z 2017-12-03 05:30:00,399 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452368 done

03T05:30:00.404900260Z 2017-12-03 05:30:00,403 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.407332697Z 2017-12-03 05:30:00,404 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452368 destroyed

03T05:30:00.409356651Z 2017-12-03 05:30:00,408 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.409395039Z "group-aggregate":

03T05:30:00.409521948Z {

03T05:30:00.410257556Z "metric": "mssql_perf_stats_Index_Searchessec_cntr_value",

03T05:30:00.410369003Z "step": "5s",

03T05:30:00.410523742Z "func":

03T05:30:00.410827854Z [

03T05:30:00.410883618Z "mean"

03T05:30:00.410899979Z ]

03T05:30:00.410910989Z },

03T05:30:00.410922808Z "range":

03T05:30:00.411340231Z {

03T05:30:00.411567555Z "from": "20171203T042958.340",

03T05:30:00.411855356Z "to": "20171203T052958.340"

03T05:30:00.411874619Z },

03T05:30:00.411981281Z "order-by": "series",

03T05:30:00.411995955Z "apply":

03T05:30:00.412033061Z [

03T05:30:00.412042262Z {

03T05:30:00.412049873Z "name": "rate"

03T05:30:00.412398987Z }

03T05:30:00.412444275Z ]

03T05:30:00.412452483Z }

03T05:30:00.412459277Z

03T05:30:00.415600681Z 2017-12-03 05:30:00,414 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 created

03T05:30:00.416145351Z 2017-12-03 05:30:00,415 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 started

03T05:30:00.418431361Z 2017-12-03 05:30:00,418 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:30:00.418473389Z 2017-12-03 05:30:00,418 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:30:00.419461835Z 2017-12-03 05:30:00,419 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:30:00.421090389Z 2017-12-03 05:30:00,420 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902485832 created

03T05:30:00.421125474Z 2017-12-03 05:30:00,421 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902485832 started

03T05:30:00.422190746Z 2017-12-03 05:30:00,421 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298378944 done

03T05:30:00.422564282Z 2017-12-03 05:30:00,422 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298378944 destroyed

03T05:30:00.426638475Z 2017-12-03 05:30:00,425 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 created

03T05:30:00.427346698Z 2017-12-03 05:30:00,426 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319768 started

03T05:30:00.428630201Z 2017-12-03 05:30:00,425 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.429575232Z 2017-12-03 05:30:00,429 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.431413868Z 2017-12-03 05:30:00,430 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.432770600Z 2017-12-03 05:30:00,432 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.432809698Z "group-aggregate":

03T05:30:00.433046791Z {

03T05:30:00.433475101Z "metric": "mssql_perf_stats_Readahead_pagessec_cntr_value",

03T05:30:00.433490670Z "step": "5s",

03T05:30:00.433498417Z "func":

03T05:30:00.433723895Z [

03T05:30:00.433740734Z "mean"

03T05:30:00.434172449Z ]

03T05:30:00.434227760Z },

03T05:30:00.434500533Z "range":

03T05:30:00.434565134Z {

03T05:30:00.434581056Z "from": "20171203T042958.340",

03T05:30:00.434994950Z "to": "20171203T052958.340"

03T05:30:00.435239416Z },

03T05:30:00.435443955Z "order-by": "series",

03T05:30:00.435460679Z "apply":

03T05:30:00.435610171Z [

03T05:30:00.435625903Z {

03T05:30:00.435635746Z "name": "rate"

03T05:30:00.435645190Z }

03T05:30:00.435981040Z ]

03T05:30:00.435997220Z }

03T05:30:00.436006272Z

03T05:30:00.436705427Z 2017-12-03 05:30:00,435 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.436915074Z 2017-12-03 05:30:00,436 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.436930961Z "group-aggregate":

03T05:30:00.436940481Z {

03T05:30:00.436948491Z "metric": "mssql_perf_stats_Page_Splitssec_cntr_value",

03T05:30:00.436957899Z "step": "5s",

03T05:30:00.436967352Z "func":

03T05:30:00.437113580Z [

03T05:30:00.437128060Z "mean"

03T05:30:00.437136542Z ]

03T05:30:00.437143890Z },

03T05:30:00.437151515Z "range":

03T05:30:00.437161463Z {

03T05:30:00.437169806Z "from": "20171203T042958.340",

03T05:30:00.437178243Z "to": "20171203T052958.340"

03T05:30:00.437187634Z },

03T05:30:00.437360769Z "order-by": "series",

03T05:30:00.437375232Z "apply":

03T05:30:00.437383859Z [

03T05:30:00.437391692Z {

03T05:30:00.437399301Z "name": "rate"

03T05:30:00.437407814Z }

03T05:30:00.437416337Z ]

03T05:30:00.437439841Z }

03T05:30:00.437450398Z

03T05:30:00.437668179Z 2017-12-03 05:30:00,437 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902352984 created

03T05:30:00.437683120Z 2017-12-03 05:30:00,437 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902352984 started

03T05:30:00.439147843Z 2017-12-03 05:30:00,438 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452464 done

03T05:30:00.439427509Z 2017-12-03 05:30:00,439 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452464 destroyed

03T05:30:00.442702343Z 2017-12-03 05:30:00,441 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.443375835Z 2017-12-03 05:30:00,443 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.443394400Z "group-aggregate":

03T05:30:00.443402213Z {

03T05:30:00.443422220Z "metric": "mssql_perf_stats_Page_writessec_cntr_value",

03T05:30:00.443431809Z "step": "5s",

03T05:30:00.443456351Z "func":

03T05:30:00.443470153Z [

03T05:30:00.443477462Z "mean"

03T05:30:00.443484720Z ]

03T05:30:00.443492063Z },

03T05:30:00.443497811Z "range":

03T05:30:00.443503930Z {

03T05:30:00.443509816Z "from": "20171203T042958.340",

03T05:30:00.443513961Z "to": "20171203T052958.340"

03T05:30:00.443517925Z },

03T05:30:00.443521617Z "order-by": "series",

03T05:30:00.443525507Z "apply":

03T05:30:00.443529344Z [

03T05:30:00.443532973Z {

03T05:30:00.443536676Z "name": "rate"

03T05:30:00.443540521Z }

03T05:30:00.443544142Z ]

03T05:30:00.443586454Z }

03T05:30:00.443595592Z

03T05:30:00.444223853Z 2017-12-03 05:30:00,443 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.446787370Z 2017-12-03 05:30:00,444 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.447150593Z "group-aggregate":

03T05:30:00.447186337Z {

03T05:30:00.447890797Z "metric": "mssql_perf_stats_Page_readssec_cntr_value",

03T05:30:00.447915520Z "step": "5s",

03T05:30:00.447999712Z "func":

03T05:30:00.448053331Z [

03T05:30:00.448065587Z "mean"

03T05:30:00.448192292Z ]

03T05:30:00.448208146Z },

03T05:30:00.448218058Z "range":

03T05:30:00.448255890Z {

03T05:30:00.448544522Z "from": "20171203T042958.340",

03T05:30:00.448924250Z "to": "20171203T052958.340"

03T05:30:00.448940567Z },

03T05:30:00.449253876Z "order-by": "series",

03T05:30:00.449311639Z "apply":

03T05:30:00.449322792Z [

03T05:30:00.449487642Z {

03T05:30:00.449515003Z "name": "rate"

03T05:30:00.449529901Z }

03T05:30:00.449538726Z ]

03T05:30:00.449688361Z }

03T05:30:00.450094518Z

03T05:30:00.454522001Z 2017-12-03 05:30:00,454 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 created

03T05:30:00.454558125Z 2017-12-03 05:30:00,454 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902418600 started

03T05:30:00.454797402Z 2017-12-03 05:30:00,454 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.455238946Z 2017-12-03 05:30:00,454 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.455260789Z "group-aggregate":

03T05:30:00.455270148Z {

03T05:30:00.455278162Z "metric": "mssql_perf_stats_Lazy_writessec_cntr_value",

03T05:30:00.455286768Z "step": "5s",

03T05:30:00.455295203Z "func":

03T05:30:00.455302932Z [

03T05:30:00.455311547Z "mean"

03T05:30:00.455319051Z ]

03T05:30:00.455324984Z },

03T05:30:00.455330612Z "range":

03T05:30:00.455336934Z {

03T05:30:00.455340975Z "from": "20171203T042958.340",

03T05:30:00.455344871Z "to": "20171203T052958.340"

03T05:30:00.455348543Z },

03T05:30:00.455352088Z "order-by": "series",

03T05:30:00.455355882Z "apply":

03T05:30:00.455359505Z [

03T05:30:00.455362967Z {

03T05:30:00.455366449Z "name": "rate"

03T05:30:00.455373657Z }

03T05:30:00.455380835Z ]

03T05:30:00.455387855Z }

03T05:30:00.455469214Z

03T05:30:00.459121279Z 2017-12-03 05:30:00,456 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.460512799Z 2017-12-03 05:30:00,459 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.460557195Z "group-aggregate":

03T05:30:00.460572358Z {

03T05:30:00.460582303Z "metric": "mssql_perf_stats_Page_lookupssec_cntr_value",

03T05:30:00.460593203Z "step": "5s",

03T05:30:00.460623057Z "func":

03T05:30:00.460634364Z [

03T05:30:00.460797238Z "mean"

03T05:30:00.460811812Z ]

03T05:30:00.460820848Z },

03T05:30:00.460828722Z "range":

03T05:30:00.460838314Z {

03T05:30:00.460847092Z "from": "20171203T042958.340",

03T05:30:00.460862318Z "to": "20171203T052958.340"

03T05:30:00.461028864Z },

03T05:30:00.461044726Z "order-by": "series",

03T05:30:00.461054169Z "apply":

03T05:30:00.461063702Z [

03T05:30:00.461072664Z {

03T05:30:00.461082400Z "name": "rate"

03T05:30:00.461561758Z }

03T05:30:00.461594871Z ]

03T05:30:00.461605318Z }

03T05:30:00.461613953Z

03T05:30:00.461778016Z 2017-12-03 05:30:00,459 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768102000 done

03T05:30:00.461795265Z 2017-12-03 05:30:00,459 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678566811264 done

03T05:30:00.462841712Z 2017-12-03 05:30:00,461 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892096 done

03T05:30:00.462903091Z 2017-12-03 05:30:00,461 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768102000 destroyed

03T05:30:00.463574864Z 2017-12-03 05:30:00,463 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892096 destroyed

03T05:30:00.464132397Z 2017-12-03 05:30:00,463 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:30:00.464900088Z 2017-12-03 05:30:00,464 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678566811264 destroyed

03T05:30:00.467397408Z 2017-12-03 05:30:00,466 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969466112 done

03T05:30:00.467476331Z 2017-12-03 05:30:00,466 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678969466112 destroyed

03T05:30:00.469062391Z 2017-12-03 05:30:00,468 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.469363329Z 2017-12-03 05:30:00,469 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.469397207Z "group-aggregate":

03T05:30:00.469435070Z {

03T05:30:00.469721374Z "metric": "mssql_perf_stats_Checkpoint_pagessec_cntr_value",

03T05:30:00.469766262Z "step": "5s",

03T05:30:00.470328928Z "func":

03T05:30:00.470344282Z [

03T05:30:00.470360688Z "mean"

03T05:30:00.470594058Z ]

03T05:30:00.470610259Z },

03T05:30:00.470632495Z "range":

03T05:30:00.470644165Z {

03T05:30:00.470677492Z "from": "20171203T042958.340",

03T05:30:00.470808957Z "to": "20171203T052958.340"

03T05:30:00.471549815Z },

03T05:30:00.471639505Z "order-by": "series",

03T05:30:00.471674267Z "apply":

03T05:30:00.471687348Z [

03T05:30:00.471696187Z {

03T05:30:00.471724754Z "name": "rate"

03T05:30:00.472318051Z }

03T05:30:00.472484053Z ]

03T05:30:00.472499330Z }

03T05:30:00.472510324Z

03T05:30:00.483777514Z 2017-12-03 05:30:00,483 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452368 done

03T05:30:00.483895554Z 2017-12-03 05:30:00,483 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340736 done

03T05:30:00.486428119Z 2017-12-03 05:30:00,484 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365452368 destroyed

03T05:30:00.487172940Z 2017-12-03 05:30:00,486 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 created

03T05:30:00.487359546Z 2017-12-03 05:30:00,486 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298340736 destroyed

03T05:30:00.487811005Z 2017-12-03 05:30:00,487 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 started

03T05:30:00.493519222Z 2017-12-03 05:30:00,493 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.493880614Z 2017-12-03 05:30:00,493 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.493897562Z "group-aggregate":

03T05:30:00.493906973Z {

03T05:30:00.493913026Z "metric": "mssql_perf_stats_Database_Cache_Memory_KB_cntr_value",

03T05:30:00.493919886Z "step": "5s",

03T05:30:00.493970934Z "func":

03T05:30:00.493989625Z [

03T05:30:00.493999982Z "mean"

03T05:30:00.494007405Z ]

03T05:30:00.494015074Z },

03T05:30:00.494022897Z "range":

03T05:30:00.494030670Z {

03T05:30:00.494038798Z "from": "20171203T042958.340",

03T05:30:00.494046509Z "to": "20171203T052958.340"

03T05:30:00.494084764Z },

03T05:30:00.494095306Z "order-by": "series",

03T05:30:00.494104017Z "apply": ""

03T05:30:00.494112575Z }

03T05:30:00.494120231Z

03T05:30:00.495689974Z 2017-12-03 05:30:00,495 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902485832 created

03T05:30:00.495725425Z 2017-12-03 05:30:00,495 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902485832 started

03T05:30:00.499489579Z 2017-12-03 05:30:00,498 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633886160 done

03T05:30:00.499532075Z 2017-12-03 05:30:00,499 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633886160 destroyed

03T05:30:00.500815855Z 2017-12-03 05:30:00,499 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 created

03T05:30:00.500842995Z 2017-12-03 05:30:00,499 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 started

03T05:30:00.501015833Z 2017-12-03 05:30:00,500 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.501031153Z 2017-12-03 05:30:00,500 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.501041607Z "group-aggregate":

03T05:30:00.501050495Z {

03T05:30:00.501059010Z "metric": "mssql_perf_stats_Optimizer_Memory_KB_cntr_value",

03T05:30:00.501108582Z "step": "5s",

03T05:30:00.501118891Z "func":

03T05:30:00.501127246Z [

03T05:30:00.501135381Z "mean"

03T05:30:00.501143920Z ]

03T05:30:00.501151987Z },

03T05:30:00.501159552Z "range":

03T05:30:00.501167731Z {

03T05:30:00.501175280Z "from": "20171203T042958.340",

03T05:30:00.501207777Z "to": "20171203T052958.340"

03T05:30:00.501218918Z },

03T05:30:00.501227146Z "order-by": "series",

03T05:30:00.501235711Z "apply": ""

03T05:30:00.501244196Z }

03T05:30:00.501251881Z

03T05:30:00.502153267Z 2017-12-03 05:30:00,501 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.502175738Z 2017-12-03 05:30:00,501 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.502186066Z "group-aggregate":

03T05:30:00.502194761Z {

03T05:30:00.502202675Z "metric": "mssql_perf_stats_SQL_Cache_Memory_KB_cntr_value",

03T05:30:00.502211266Z "step": "5s",

03T05:30:00.502233760Z "func":

03T05:30:00.502243507Z [

03T05:30:00.502251264Z "mean"

03T05:30:00.502259060Z ]

03T05:30:00.502266631Z },

03T05:30:00.502274428Z "range":

03T05:30:00.502282926Z {

03T05:30:00.502290718Z "from": "20171203T042958.340",

03T05:30:00.502298381Z "to": "20171203T052958.340"

03T05:30:00.502306308Z },

03T05:30:00.502314265Z "order-by": "series",

03T05:30:00.502322595Z "apply": ""

03T05:30:00.502336214Z }

03T05:30:00.502703761Z

03T05:30:00.502722644Z 2017-12-03 05:30:00,502 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768102080 done

03T05:30:00.505033106Z 2017-12-03 05:30:00,502 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678768102080 destroyed

03T05:30:00.505079126Z 2017-12-03 05:30:00,503 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892096 done

03T05:30:00.505090359Z 2017-12-03 05:30:00,503 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892096 destroyed

03T05:30:00.514565881Z 2017-12-03 05:30:00,513 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 created

03T05:30:00.514598812Z 2017-12-03 05:30:00,514 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 started

03T05:30:00.519796289Z 2017-12-03 05:30:00,518 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.519838351Z 2017-12-03 05:30:00,519 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.519848476Z "group-aggregate":

03T05:30:00.519857319Z {

03T05:30:00.519864340Z "metric": "mssql_perf_stats_Log_Pool_Memory_KB_cntr_value",

03T05:30:00.519873041Z "step": "5s",

03T05:30:00.519881220Z "func":

03T05:30:00.519888841Z [

03T05:30:00.519897544Z "mean"

03T05:30:00.519905452Z ]

03T05:30:00.519923260Z },

03T05:30:00.519934138Z "range":

03T05:30:00.519942729Z {

03T05:30:00.519950742Z "from": "20171203T042958.340",

03T05:30:00.519959172Z "to": "20171203T052958.340"

03T05:30:00.519966498Z },

03T05:30:00.519974303Z "order-by": "series",

03T05:30:00.519981775Z "apply": ""

03T05:30:00.520709151Z }

03T05:30:00.520753544Z

03T05:30:00.522003261Z 2017-12-03 05:30:00,520 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902353752 created

03T05:30:00.522039791Z 2017-12-03 05:30:00,521 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902353752 started

03T05:30:00.522638772Z 2017-12-03 05:30:00,521 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 created

03T05:30:00.522678353Z 2017-12-03 05:30:00,521 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902484936 started

03T05:30:00.526777647Z 2017-12-03 05:30:00,526 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892096 done

03T05:30:00.527356153Z 2017-12-03 05:30:00,526 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.527377240Z 2017-12-03 05:30:00,527 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.527388264Z "group-aggregate":

03T05:30:00.527396680Z {

03T05:30:00.527404116Z "metric": "mssql_perf_stats_Connection_Memory_KB_cntr_value",

03T05:30:00.527412228Z "step": "5s",

03T05:30:00.527419896Z "func":

03T05:30:00.527427387Z [

03T05:30:00.527434931Z "mean"

03T05:30:00.527442018Z ]

03T05:30:00.527448987Z },

03T05:30:00.527455401Z "range":

03T05:30:00.527462063Z {

03T05:30:00.527468525Z "from": "20171203T042958.340",

03T05:30:00.527475376Z "to": "20171203T052958.340"

03T05:30:00.527482361Z },

03T05:30:00.527489227Z "order-by": "series",

03T05:30:00.527496564Z "apply": ""

03T05:30:00.527504011Z }

03T05:30:00.527511559Z

03T05:30:00.528001831Z 2017-12-03 05:30:00,527 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678633892096 destroyed

03T05:30:00.534127755Z 2017-12-03 05:30:00,533 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:30:00.563837010Z 2017-12-03 05:30:00,547 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365449920 done

03T05:30:00.563853165Z 2017-12-03 05:30:00,550 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678365449920 destroyed

03T05:30:00.563857764Z 2017-12-03 05:30:00,554 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 created

03T05:30:00.563861797Z 2017-12-03 05:30:00,554 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902353752 created

03T05:30:00.563867294Z 2017-12-03 05:30:00,554 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902353752 started

03T05:30:00.563882585Z 2017-12-03 05:30:00,554 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678902319384 started

03T05:30:00.563889928Z 2017-12-03 05:30:00,555 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.563894723Z 2017-12-03 05:30:00,555 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.563898452Z "group-aggregate":

03T05:30:00.563902166Z {

03T05:30:00.563905651Z "metric": "mssql_perf_stats_Lock_Memory_KB_cntr_value",

03T05:30:00.563909533Z "step": "5s",

03T05:30:00.563913914Z "func":

03T05:30:00.563917504Z [

03T05:30:00.563920884Z "mean"

03T05:30:00.563924363Z ]

03T05:30:00.563927693Z },

03T05:30:00.563931036Z "range":

03T05:30:00.563934481Z {

03T05:30:00.563937811Z "from": "20171203T042958.340",

03T05:30:00.563941399Z "to": "20171203T052958.340"

03T05:30:00.563944944Z },

03T05:30:00.563948244Z "order-by": "series",

03T05:30:00.563951808Z "apply": ""

03T05:30:00.563955280Z }

03T05:30:00.563958619Z

03T05:30:00.563962083Z 2017-12-03 05:30:00,556 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.563965757Z 2017-12-03 05:30:00,557 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.563986329Z "group-aggregate":

03T05:30:00.563991848Z {

03T05:30:00.563995424Z "metric": "mssql_io_history_num_of_reads",

03T05:30:00.563999169Z "step": "5s",

03T05:30:00.564002727Z "func":

03T05:30:00.564006148Z [

03T05:30:00.564009644Z "mean"

03T05:30:00.564013196Z ]

03T05:30:00.564019098Z },

03T05:30:00.564062501Z "range":

03T05:30:00.564071208Z {

03T05:30:00.564077428Z "from": "20171203T042958.340",

03T05:30:00.564083178Z "to": "20171203T052958.340"

03T05:30:00.564089371Z },

03T05:30:00.564093809Z "order-by": "series",

03T05:30:00.564097676Z "apply":

03T05:30:00.564101219Z [

03T05:30:00.564104650Z {

03T05:30:00.564113790Z "name": "rate"

03T05:30:00.564117961Z }

03T05:30:00.564121372Z ]

03T05:30:00.564167504Z }

03T05:30:00.564173171Z

03T05:30:00.564176859Z 2017-12-03 05:30:00,560 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298383152 done

03T05:30:00.566000929Z 2017-12-03 05:30:00,563 Main [TRACE] /Akumuli/akumulid/logger.cpp(22) Can't open next iterator because not found

03T05:30:00.566752750Z 2017-12-03 05:30:00,564 http [INFO] /Akumuli/akumulid/logger.cpp(16) Cursor 140678298383152 destroyed

03T05:30:00.568273040Z 2017-12-03 05:30:00,565 Main [INFO] /Akumuli/akumulid/logger.cpp(16) Parsing query:

03T05:30:00.568424377Z 2017-12-03 05:30:00,567 Main [INFO] /Akumuli/akumulid/logger.cpp(16) {

03T05:30:00.568445889Z "group-aggregate":

03T05:30:00.568455980Z {

03T05:30:00.568466278Z "metric": "mssql_io_history_num_of_writes",

03T05:30:00.568475564Z "step": "5s",

03T05:30:00.568507863Z "func":

03T05:30:00.568521983Z [

03T05:30:00.569240802Z "mean"

03T05:30:00.569650132Z ]

03T05:30:00.569851053Z },

03T05:30:00.569866051Z "range":

03T05:30:00.569874392Z {

03T05:30:00.569881713Z "from": "20171203T042958.340",

Lazin commented 6 years ago

This log looks quite normal to me. The "Can't open next iterator because not found" is a trace message. It shows that the iteration has stopped during the query execution because storage subsystem returned "not found" error code. It happens when it already returned all the data.

I tried to run the container but wasn't able to do this yet (probably due to old docker installation on my machine). How should I start this container? Does it require any configuration or command line arguments?

Lazin commented 6 years ago

And BTW, where the database files are stored? Inside the container or I should provide some location?

dmitrios commented 6 years ago

I would recommend update Docker version to latest. Below is the example for running Akumuli container I had to create, it is on Docker Hub:

docker run -d -p 9191:8181 -p 9292:8282 -p 9393:8383 -v /Users/myuser/myprojects/tmp:/Akumuli dmitrio/experimental

The above maps external ports and the data directory. You can use/map same ports on the host to the container and any directory on the host (as long us this directory under /Users ), because it is required by Docker. If there is no volume, container will will use /Akumuli local directory. I usually map to same ports on the host. You can store data in host directory as shown or create blind volume.

docker run -d -p 8181:8181 -p 8282:8282 -p 8383:8383 -v /Users/myuser/myprojects/tmp:/Akumuli dmitrio/experimental

I would run it locally for 3-6 hours with predictable small load and look at memory allocation patterns. Typically, I do this with Telegraf & InfluxDB containers on the same host. So, you can see memory, CPU and IO over time independently. For example, our collector polling metrics from MSSQL and MySQL and sending them to Akumuli uses near constant 28Mb and 0.056% CPU time. The Akumuli is around 4-5% constant CPU On the other note, it would be good to have Akumuli proxy for redundancy: write once to proxy, which does two writes to separate Akumuli instances if someone wants high availability to query metrics. Prometheus uses multiple redundant instances polling same metrics, so the proxy option is push mode is likely the simplest.

dmitrios commented 6 years ago

Below are Docker container metrics, with Akumuli and InfluxDb deployed on the same host. Perhaps you can see the results for the CPU.

sonar-docker-perf
Lazin commented 6 years ago

Do I understand it right that you're talking about idle CPU time? If it is a concern I can fix it quite easily. I'm mostly using it on the beefy machine, maybe this is why I haven't noticed this yet.

It is possible to write to several akumuli instances using the duplicator or some similar tool. I'm planning to implement specialized proxy in the future. This proxy should be able to synchronize changes if one of the akumuli instances goes offline for some time. But to do this I need to implement updates. Storage engine only allows appending new data at the moment.

dmitrios commented 6 years ago

Yes, the CPU time, everything else looks normal. The picture shows the data from Docker running Mac Pro, so CPU numbers can be different depending on hardware. If CPU consumption can be reduced, it would be a good thing. It will also will help adopting Akumuli for more scenarios, including sidecar on Docker and K8S, when low CPU and memory footprint are important. I'll take a look at duplicator. Not sure if someone tried UDP broadcast on local subnet when TCP is not preferred protocol to emit metrics.

Lazin commented 6 years ago

OK, thanks for the advice, I'll do it.

Lazin commented 6 years ago

Fixed that idle CPU load.

dmitrios commented 6 years ago

Looks much better! akumuli-cpu-02

dmitrios commented 6 years ago

Looks very good. Btw, with Grafana and InfluxDb folks pushing container images to Docker hub on regular basis, it would be nice to have an official Akumuli image. The repository already has everything to run build in container and it works fine. For example: docker build -t akumuli/akumuli ./docker and push.

Lazin commented 6 years ago

Docker image is available here - https://hub.docker.com/r/akumuli/akumuli/ This repository contains only stable builds built from master branch (project follows green master policy).

dmitrios commented 6 years ago

I did run master image on K8S(v18.2), with this Helm chart. The issue is that after Akumuli pod restart all metrics collected and timestamped before new pod started do not show up in Grafana. The logs and data on persistent volume are intact and log is appended after pod restarts. Running image on Docker is likely have the same problem if data is mapped to persistent volume.

Lazin commented 6 years ago

It's a known issue. Akumuli doesn't have a write-ahead log at the moment. When the server app gets restarted improperly you can lose recent data. The exact amount of lost data depend on write speed. To prevent this you should send SIGINT to the server application. The app will shut down properly and all data will be intact.

The next version won't have this issue. I already developed a WAL prototype and after some testing, I'm going to integrate it. Even with WAL it's better to stop the app properly because crash recovery extends startup time.

dmitrios commented 6 years ago

I think it may be because container is not handling SIGTERM properly. More details here

Lazin commented 6 years ago

I can just handle SIGTERM the same way I'm handling SIGINT. Not a big deal.

Lazin commented 6 years ago

I added SIGTERM handling, docker image is available as well.

dmitrios commented 6 years ago

I did take a quick look: the behavior is the same. Is SIGTERM being logged during the shutdown? I will look what happens when I have 4-6 hours of data.

Lazin commented 6 years ago

Yes, it's logged. The exact line is SIGTERM handler called. I tested it myself and it works without docker. But when I stopped docker container akumulid didn't received any signals at all. Documentation says that docker should send SIGTERM to the root process. Maybe akumulid is not a root process, since I'm starting it from shell script.

Lazin commented 6 years ago

docker inspect -f '{{.State.ExitCode}}' <imageid> returns 143, so it looks like the script is not responding to the signal. I need to rework this shell script to handle the situation.

dmitrios commented 6 years ago

I suspect that when bash is explicitly set with akumuli.sh as argument, it will send SIGTERM to the child process. Perhaps tini can do the same trick if it is set with argument to another entry point as well.

Lazin commented 6 years ago

I fixed this in PR #239. I had to start the app in a different way so docker could send the signal. The image is already in the akumuli/test and will hit main docker repo later this day.

dmitrios commented 6 years ago

Fixed - good job. Tested akumuli/test - it logs "SIGTERM handler called" on Kubernetes v1.8.2 Also, added termination grace period 20s to the Helm chart for Akumuli, should be sufficient as response to SIGTERM is near instant. This chart configures liveness probe to poll api/stats endpoint: if persistent data volume is gone, pod will be marked as unhealthy by Kubernetes.

Lazin commented 6 years ago

I think 20s is more than enough. The PR is merged.