Juniper / open-nti

Open Network Telemetry Collector build with open source tools
Apache License 2.0
232 stars 93 forks source link

no data seemingly in influxdb or displayed by Grafana #51

Closed wmclendon closed 8 years ago

wmclendon commented 8 years ago

Pulled the repository this morning and ran on Ubuntu 14.04 server. Switch sending analytics data was QFX5100 running 14.1X53-D15 -- I was able to verify that the QFX5100 is sending the data on UDP port 50020 and the server is receiving it. After that i'm not sure why it fails, but below is what I was able to discern:

At this point I don't know if I screwed something up (not sure how I could...cloned the repo, then ran it per documentation), or if there is a versioning issue, or what.

My best guess is either issue with Fluentd or the juniper plugin for it sending the data to Influxdb, but I really don't know anything about Fluentd or Influxdb. Couldn't see how to get any info out of Fluentd as to what it was actually doing.

Thanks,

Will

dgarros commented 8 years ago

Hi @wmclendon

if you are seeing "juniper.analyticsd" in Influxdb most likely some data are recorded you can check by running this query in Influx

SELECT * FROM "juniper.analyticsd"

If data are in the Database and are not showing on the GUI, usually it's because of a Timestamp/timezone issue. Please try to zoom out in the GUI and check the time on your device.

Let me know how it goes Thanks for using OpenNTI Damien

wmclendon commented 8 years ago

hi Damien,

thank you for your reply. I was mistaken it is actually "jnpr.analyticsd" -- in either case, when I changed the dropdown of influxdb to be the "juniper" database and run SELECT * FROM "jnpr.analyticsd" I got "Success! (no results to display)"

since you mentioned time I started checking. Incidentally the QFX5100 I was using in our lab did not have NTP configured so naturally it's time was not correct. Once I enabled NTP I went back over to InfluxDB GUI and re-ran the SELECT * FROM "jnpr.analyticsd", and sure enough I had data

After the fact it makes sense for something like this that time would need to be synchronized (at least for good, useful data), but wasn't readily obvious that time --had-- to be synchronized between the systems for everything to work correctly at all. Oh well, live and learn I guess! Learned some things in the process since I had never used Docker before, so not a total waste of time this past weekend trying to get this to work :)

Now for the hard part -- figuring out how to operationalize and use these tools to gather the data in a production environment

Cheers,

Will

dgarros commented 8 years ago

hi @wmclendon I'm glad it's working now

let me know if we can help with the production part, and if you manage it on your own please let us know how it looks, it's always interesting.

Also, if Influxdb or Grafana are not the best components for you, it's easy to use something else.

Thanks Damien

wmclendon commented 8 years ago

hi Damien,

I actually work for a Juniper partner and we are interested in this both internally and to help our customers better leverage the technology available to them. perhaps we could take this conversation offline? I can be found on twitter at willmc25