Where is VictoriaMetrics's Data Dir

waittingsummer commented 1 month ago

Question and Steps to reproduce

我参考https://flashcat.cloud/docs/content/flashcat-monitor/nightingale-v7/install/binary/ 部署单机版夜莺V7 具体为关系库mysql + 实时库redis + 平台n9e + 时序库VictoriaMetrics + 采集装置categraf 现在跑了有一段时间了一直有一个疑问，VictoriaMetrics是个单可执行程序连配置文件都没的时序库那么这段时间的采集数据都存在哪里了呢？是不是n9e下的integrations目录？

Relevant logs and configurations

n9e
[[Pushgw.Writers]]
# Url = "http://127.0.0.1:8480/insert/0/prometheus/api/v1/write"
Url = "http://127.0.0.1:8428/api/v1/write"

categraf
[[writers]]
url = "http://127.0.0.1:17000/prometheus/v1/write"

Version

序号组件名称版本号 1 实时库 Redis 6.0.8 2 关系库 MySQL 5.7.30 3 平台 Nightingale 7.0.0-beta.9 4 时序库 VictoriaMetrics 1.101.0 5 采集器 Categraf 0.3.69

710leo commented 1 month ago

可以看下 VictoriaMetrics 的官方文档 https://docs.victoriametrics.com/single-server-victoriametrics/#how-to-start-victoriametrics

UlricQin commented 1 month ago

Question and Steps to reproduce

我参考https://flashcat.cloud/docs/content/flashcat-monitor/nightingale-v7/install/binary/ 部署单机版夜莺V7 具体为关系库mysql + 实时库redis + 平台n9e + 时序库VictoriaMetrics + 采集装置categraf 现在跑了有一段时间了一直有一个疑问，VictoriaMetrics是个单可执行程序连配置文件都没的时序库那么这段时间的采集数据都存在哪里了呢？是不是n9e下的integrations目录？

Relevant logs and configurations
n9e
[[Pushgw.Writers]]
# Url = "http://127.0.0.1:8480/insert/0/prometheus/api/v1/write"
Url = "http://127.0.0.1:8428/api/v1/write"

categraf
[[writers]]
url = "http://127.0.0.1:17000/prometheus/v1/write"
Version

序号组件名称版本号 1 实时库 Redis 6.0.8 2 关系库 MySQL 5.7.30 3 平台 Nightingale 7.0.0-beta.9 4 时序库 VictoriaMetrics 1.101.0 5 采集器 Categraf 0.3.69

ulric@ulric-flashcat tgz % ./victoria-metrics-prod --help|grep storage
        The interval for guaranteed saving of in-memory data to disk. The saved data survives unclean shutdown such as OOM crash, hardware reset, SIGKILL, etc. Bigger intervals may help increasing lifetime of flash storage with limited write cycles (e.g. Raspberry PI). Smaller intervals increase disk IO load. Minimum supported value is 1s (default 5s)
        The number of members in the cluster, which scrape the same targets. If the replication factor is greater than 1, then the deduplication must be enabled at remote storage side. See https://docs.victoriametrics.com/#deduplication (default 1)
        Optional URL to push metrics exposed at /metrics page. See https://docs.victoriametrics.com/#push-metrics . By default metrics exposed at /metrics page aren't pushed to any remote storage
        Whether to sort labels for incoming samples before writing them to storage. This may be needed for reducing memory usage at storage when the order of labels in incoming samples is random. For example, if m{k1="v1",k2="v2"} may be sent as m{k2="v2",k1="v1"}. Enabled sorting for labels can slow down ingestion performance a bit
  -storage.cacheSizeIndexDBDataBlocks size
  -storage.cacheSizeIndexDBIndexBlocks size
  -storage.cacheSizeIndexDBTagFilters size
  -storage.cacheSizeStorageTSID size
        Overrides max size for storage/tsid cache. See https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#cache-tuning
  -storage.maxDailySeries int
        The maximum number of unique series can be added to the storage during the last 24 hours. Excess series are logged and dropped. This can be useful for limiting series churn rate. See https://docs.victoriametrics.com/#cardinality-limiter . See also -storage.maxHourlySeries
  -storage.maxHourlySeries int
        The maximum number of unique series can be added to the storage during the last hour. Excess series are logged and dropped. This can be useful for limiting series cardinality. See https://docs.victoriametrics.com/#cardinality-limiter . See also -storage.maxDailySeries
  -storage.minFreeDiskSpaceBytes size
        The minimum free disk space at -storageDataPath after which the storage stops accepting new data
  -storageDataPath string
        Path to storage data (default "victoria-metrics-data")

从最后一个参数 storageDataPath 可以看出来，没有指定的话默认是 victoria-metrics-data

waittingsummer commented 1 month ago

Question and Steps to reproduce

我参考https://flashcat.cloud/docs/content/flashcat-monitor/nightingale-v7/install/binary/ 部署单机版夜莺V7 具体为关系库mysql + 实时库redis + 平台n9e + 时序库VictoriaMetrics + 采集装置categraf 现在跑了有一段时间了一直有一个疑问，VictoriaMetrics是个单可执行程序连配置文件都没的时序库那么这段时间的采集数据都存在哪里了呢？是不是n9e下的integrations目录？

Relevant logs and configurations
n9e
[[Pushgw.Writers]]
# Url = "http://127.0.0.1:8480/insert/0/prometheus/api/v1/write"
Url = "http://127.0.0.1:8428/api/v1/write"

categraf
[[writers]]
url = "http://127.0.0.1:17000/prometheus/v1/write"
Version

序号组件名称版本号 1 实时库 Redis 6.0.8 2 关系库 MySQL 5.7.30 3 平台 Nightingale 7.0.0-beta.9 4 时序库 VictoriaMetrics 1.101.0 5 采集器 Categraf 0.3.69

ulric@ulric-flashcat tgz % ./victoria-metrics-prod --help|grep storage
      The interval for guaranteed saving of in-memory data to disk. The saved data survives unclean shutdown such as OOM crash, hardware reset, SIGKILL, etc. Bigger intervals may help increasing lifetime of flash storage with limited write cycles (e.g. Raspberry PI). Smaller intervals increase disk IO load. Minimum supported value is 1s (default 5s)
      The number of members in the cluster, which scrape the same targets. If the replication factor is greater than 1, then the deduplication must be enabled at remote storage side. See https://docs.victoriametrics.com/#deduplication (default 1)
      Optional URL to push metrics exposed at /metrics page. See https://docs.victoriametrics.com/#push-metrics . By default metrics exposed at /metrics page aren't pushed to any remote storage
      Whether to sort labels for incoming samples before writing them to storage. This may be needed for reducing memory usage at storage when the order of labels in incoming samples is random. For example, if m{k1="v1",k2="v2"} may be sent as m{k2="v2",k1="v1"}. Enabled sorting for labels can slow down ingestion performance a bit
  -storage.cacheSizeIndexDBDataBlocks size
  -storage.cacheSizeIndexDBIndexBlocks size
  -storage.cacheSizeIndexDBTagFilters size
  -storage.cacheSizeStorageTSID size
      Overrides max size for storage/tsid cache. See https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#cache-tuning
  -storage.maxDailySeries int
      The maximum number of unique series can be added to the storage during the last 24 hours. Excess series are logged and dropped. This can be useful for limiting series churn rate. See https://docs.victoriametrics.com/#cardinality-limiter . See also -storage.maxHourlySeries
  -storage.maxHourlySeries int
      The maximum number of unique series can be added to the storage during the last hour. Excess series are logged and dropped. This can be useful for limiting series cardinality. See https://docs.victoriametrics.com/#cardinality-limiter . See also -storage.maxDailySeries
  -storage.minFreeDiskSpaceBytes size
      The minimum free disk space at -storageDataPath after which the storage stops accepting new data
  -storageDataPath string
      Path to storage data (default "victoria-metrics-data")

从最后一个参数 storageDataPath 可以看出来，没有指定的话默认是 victoria-metrics-data

嗯文档是这么写的，但是我实际测试，未指定不会在程序目录下生成victoria-metrics-data这个目录，我也到处找了，确实没有。但n9e平台上确实能查这段时间数据。太奇怪了。修改配置指定了一个目录，重启后目录下有文件生成

waittingsummer commented 1 month ago

victoria-metrics-data

额，找到了就在根目录下

ccfos / nightingale