akpw / mktxp

Prometheus Exporter for Mikrotik RouterOS devices
Other
528 stars 103 forks source link

singular dash multiple servers #191

Open mwarren-6 opened 2 months ago

mwarren-6 commented 2 months ago

I have been trying to combine this to allow load balancing so the system stops timing out. We have small servers all over and could use the program to run on them as well.
Example:

akpw commented 2 months ago

@mwarren-6 can you expand a bit on the request? assuming the problem is timeout of network api calls from mktxp to multiple mikrotik devices, have you tried tweaking those _mktxp.conf parameters in to cover what your situation?

    socket_timeout = 2
    fetch_routers_in_parallel = False   # Fetch metrics from multiple routers in parallel / sequentially     
    max_worker_threads = 5              # Max number of worker threads that can fetch routers (parallel fetch only)
    max_scrape_duration = 10            # Max duration of individual routers' metrics collection (parallel fetch only)
    total_max_scrape_duration = 30      # Max overall duration of all metrics collection (parallel fetch only)
mwarren-6 commented 2 months ago

That file has default settings similar to what you posted.
What I am needing is to have multiple servers, throughout the network collecting data and bringing them into one dashboard. We have hundreds of routers we would like to poll. We have small servers distributed on the network that would make this process faster and handle the polling.
I believe this is more on the Prometheus collecting of data config.