pageauc
commented
5 years ago Richie
Please note speed data is also stored in a sqlite3 database. You can query that DB for data. I have several scripts that produce graphs using gnuplot graphs. I formatted this data in html format and query can be run from menubox.sh. I have not done much with this project for several months. Extracting data from the sqlite3 db would be easier than using the csv file since you can filter and format the data better by querying the sqlite3 DB. example from sql-speed-gt.sh below. Note $speed is a variable supplied when script is run. I set speed gt to allow eliminating pedestrians or slow moving objects. It can also be used to filter for only faster moving objects. Sometimes my camera picks up birds that fly in front of camera.
sqlite3 data/speed_cam.db -column \ "select log_date, log_hour, count(*) \ from speed \ where ave_speed > $speed \ group by log_date, log_hour \ order by log_date;" > hour_count.txt
The process of sending update data to elastic-search can be a separate process run from a crontab that updates every every specified specified time period eg Minutes, Hours, Days Etc with the latest data updates and need not be part of the speed-cam.py code. If the last transmitted data is recorded then only the delta data records would need to be send. Using the crontab you can schedule elastic-search updates every hour or number of minutes as required.
Not sure what you mean by calculate speeds differently on direction. Currently there is only one calibration for both directions. Not sure if you want separate calibration settings for L2R and R2L or different unit of speed like ft/sec. Needs more explaining.
Note speed camera also includes rclone interface for syncing data to a cloud service. Eg Google Drive, Drop Box etc.
Regards Claude ...
When I get a chance I will look at the REST API.
On Wed, Jun 26, 2019 at 7:01 PM Richie Jarvis notifications@github.com wrote:
Hi Claude,
Great work with this package. We in the village of Chailey, UK want to monitor the amount and speed of traffic on the A275. The road is a major trunk road, but single-lane, and 40mph for most of the village. https://www.google.com/maps/place/50°56'18.7"N+0°01'18.8"W https://www.google.com/maps/place/50%C2%B056'18.7%22N+0%C2%B001'18.8%22W
The plan is to have multiple raspberry pi's with your software on running. We then would like to merge the data and display it. I happen to work for elastic.co, so have been playing around on my ElasticStack lab at home. I've put this simple graph-set together by using logstash to read the csv file, and import into elasticsearch. I am having to run logstash on a separate server and xfer the csv file there first at the moment. The fingerprint part gives each detection a unique stamp to avoid duplicates.
For reference, here is the logstash config:
input {
file {
path => "/speed-camera/speed-cam.csv" sincedb_path => "/tmp/csv.db" start_position => "beginning"}
}
filter {
csv {
separator => "," columns => ["Date","Hour","Minute","Speed","Unit","Image","X","Y","W","H","Area","Direction"]}
fingerprint {
source => "message" target => "[@metadata][fingerprint]" method => "SHA1" key => "ChaileySpeed" base64encode => true}
mutate {
add_field => [ "timestamp","%{Date}%{Hour}:%{Minute}" ] remove_field => ["Hour","Minute"] remove_field => ["message"]}
mutate {
convert => { "Speed" => "float" }}
date {
match => ["timestamp","yyyyMMddHH:mm"] target => "Date"}
alter {
condrewrite => [ "Direction","L2R", "Southbound", "Direction","R2L", "Northbound" ]}
}
output {
elasticsearch {
hosts => [ "https://my-host:9243" ] cacert => "/etc/logstash/certs/ca.crt" user => "redacted" password => "redacted" index => "speedcam-%{+YYYY.MM.dd}" document_id => "%{[@metadata][fingerprint]}"}
stdout {codec => "rubydebug"}
}
Here is the dashboard from kibana: [image: Screenshot_2019-06-26 SpeedCamera Dashboard - Kibana] https://user-images.githubusercontent.com/900210/60220532-44d2c900-986e-11e9-8a85-815888c47610.png
I'd like to make it so that the speedcamera program makes a direct REST call to elasticsearch. Is that something you could help with? The REST API call is pretty simple - see https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-index_.html
I would also like to see the ability to calculate speeds differently depending on direction too if possible.
How can I help?
Cheers,
Richie
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/pageauc/speed-camera/issues/36?email_source=notifications&email_token=ABNPKZHTVT4CTLJDDONVPFLP4PYNVA5CNFSM4H3WW5T2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4G35UFGQ, or mute the thread https://github.com/notifications/unsubscribe-auth/ABNPKZE4NCB5X27DZTJ75SLP4PYNVANCNFSM4H3WW5TQ .
-- See my YouTube Channel at http://www.youtube.com/user/pageaucp
richiejarvis
Hi Claude,
Great work with this package. We in the village of Chailey, UK want to monitor the amount and speed of traffic on the A275. The road is a major trunk road, but single-lane, and 40mph for most of the village. https://www.google.com/maps/place/50°56'18.7"N+0°01'18.8"W
The plan is to have multiple raspberry pi's with your software on running. We then would like to merge the data and display it. I happen to work for elastic.co, so have been playing around on my ElasticStack lab at home. I've put this simple graph-set together by using logstash to read the csv file, and import into elasticsearch. I am having to run logstash on a separate server and xfer the csv file there first at the moment. The fingerprint part gives each detection a unique stamp to avoid duplicates.
For reference, here is the logstash config:
Here is the dashboard from kibana:
I'd like to make it so that the speedcamera program makes a direct REST call to elasticsearch. Is that something you could help with? The REST API call is pretty simple - see https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-index_.html
I would also like to see the ability to calculate speeds differently depending on direction too if possible.
How can I help?
Cheers,
Richie