piLogger

This is the piLogger. The main focus is to log temperatures with Raspberry Pi and 1wire devices.

Supported controllers:

AbioWire
DS9490R

Features:

Simple configuration
Simple management of devices
Automated gathering of temperature data at configurable intervals
RRDtool generated graphs

Installation

The installation is easy. Just clone this repository, run ./configure then ./setup.sh. The result is an etc/piLogger.conf file, which is ready to go for most configurations. After the initial installation, set up eventual aliases in the etc/aliases.conf file.

Installation of the software

Get yourself a Raspberry Pi
Install an SD card with the latest version of Raspbian and execute the following commands after power on
- Set an IP address in /etc/network/interfaces
- Expand the filesystem with the sudo raspi-config utility
- Set the correct time zone with the sudo raspi-config utility
- Update sources sudo apt-get update
- Upgrade the system sudo apt-get -y dist-upgrade
- Reboot sudo reboot

Optional environment config

sudo update-alternatives --set editor /usr/bin/vim.tiny

Fetch the piLogger software from GitHub

sudo apt-get install git
git clone https://github.com/maglub/piLogger
cd piLogger

Configure the installation

./configure --withLocale

#--- if you use the bit-bang 1wire kernel module, you need to point to the proper oneWireDir 
oneWireDir=/sys/bus/w1/devices ./configure --withLocale

An alternative is to minimize the installation footprint by removing unused packages:

./configure --withLocale --minimizeInstall

Run ./setup.sh which will install necessary packages (this will take ca 5 - 10 minutes)
sudo reboot since the install of owfs will not work before

Now do step 1 below (Configuration of your setup), or go through the installation manually step by step.

Configuration of your setup

Quick setup (skip this step if you really want to understand what is happening)
```
cd ~/piLogger/bin
./dbSetup.sh --setup

(crontab -l 2>/dev/null ;cat ~/piLogger/etc/cron/crontab.txt ) | crontab -
```
This will:
- Create any missing tables in the database
- Scan the 1wire filesystem for sensor devices
- Setup the "default" plot group with all found devices
- Setup three plot configurations for the web gui
  - 12h
  - 24h
  - 168h
- Setup your crontab
Now you will have a setup that is ready to be used through the web gui. Note that you have not set up any aliases for your devices yet. See 3. below.

Scan for devices (into ~/piLogger/etc/devices.scanned)

cd ~/piLogger/bin
./dbTool --setup --db
./dbTool --scan

This should show your connected devices and add them to ~/piLogger/etc/devices.scanned, and show you what ./dbTool commands to run to add the devices to the configuration database.

Example:

./dbTool --scan
20150112_184949;dbTool;  - Scanning for devices into /home/pi/piLogger/bin/../etc/devices.scanned
/mnt/1wire/28.263943050000
/mnt/1wire/28.41622F050000
/mnt/1wire/28.EFBB4E050000
Add devices not yet in the database by copy/paste the following:

./dbTool --add -d --deviceType 1wire --deviceId 28.263943050000 --devicePath /mnt/1wire/28.263943050000
./dbTool --add -d --deviceType 1wire --deviceId 28.41622F050000 --devicePath /mnt/1wire/28.41622F050000
./dbTool --add -d --deviceType 1wire --deviceId 28.EFBB4E050000 --devicePath /mnt/1wire/28.EFBB4E050000

Add your devices by copy/paste the ./dbTool rows into your shell.

Check that the devices were added to the database:

./dbTool -d

Set up aliases for your devices

Check the current aliases
```
./dbTool -a
```
If the aliases are the same as the device id's, you can set an alias by running the following command:
```
./dbTool --add -a --deviceId XXXX --deviceAlias your_alias
```
To speed things up, you can use the following command to help you create the aliases:
```
./dbTool -d | xargs -L1 -IX echo ./dbTool -a --add --deviceId X --deviceAlias YYY
```

Set up a "default" plot group with all devices:

./dbTool -d | xargs -L1 -I X ./dbTool --add -pg --plotGroup default --deviceId X

Set up a default web gui layout/plot config

./dbTool -pc --add --plotConfig default --plotGroup default --timeSpan 12h --plotWidth 6 --plotPriority 1
./dbTool -pc --add --plotConfig default --plotGroup default --timeSpan 24h --plotWidth 6 --plotPriority 2
./dbTool -pc --add --plotConfig default --plotGroup default --timeSpan 168h --plotWidth 12 --plotPriority 3

Test that the logging works, and that new rrd files are created.

~/piLogger/bin/logAll --db

Check that the RRD files are created properly, one per device connected to your 1wire interface.

pi@raspberrypi ~/piLogger/bin $ ls -la /var/lib/piLogger/db
total 20264
drwxr-xr-x 2 pi pi     4096 Feb  7 14:28 .
drwxr-xr-x 5 pi pi     4096 Feb  7 14:21 ..
-rw-r--r-- 1 pi pi 10370124 Feb  7 14:28 28.12ED2F040000.rrd
-rw-r--r-- 1 pi pi 10370124 Feb  7 14:28 28.90EC2F040000.rrd

Refresh the cache files
```
~/piLogger/bin/refreshCaches
```

And lastly, set up cron so that you log and create the caches at a regular basis

(crontab -l 2>/dev/null ;cat ~/piLogger/etc/cron/crontab.txt ) | crontab -

Your crontab should look something like this:

# m h  dom mon dow   command
*/1 * * * * base=/home/pi/piLogger ; $base/bin/logAll --db >/dev/null 2>&1 ; $base/bin/refreshCaches 12h ; $base/bin/refreshCaches sensors
*/10 * * * * /home/pi/piLogger/bin/refreshCaches 12h 
4 * * * * /home/pi/piLogger/bin/refreshCaches 24h
5 */6 * * * /home/pi/piLogger/bin/refreshCaches 168h

Done! Test your webgui by entering the IP address of your Raspberry Pi in the address field in your browser.

Setting up remote logging

Enable remoteLogging in the etc/piLogger.conf file

remoteLogging=true

Symlink the remote logging scripts that you want to use to your data directory

ln -s /home/pi/piLogger/remote-logging.d/piLogger-influx /var/lib/piLogger/remote-logging-enabled/piLogger-influx

Configure the remote logging script in your etc/piLogger.conf file

#--- influx
influxHost=192.168.4.82
influxToken=SECRET_TOKEN
influxPort=8086
influxOrg=smalometern.com
influxBucket=laggarbacken
influxSender=lag-pilogger-r01

Setting a new admin password

Use the ~/piLogger/bin/resetPassword command to set a new password

~/piLogger/bin/resetPassword "hardToGu3ssP4ssw0rd"

Note: some characters are naturally expanded on the command line, so make sure to use "" or '' around your password if it contains special characters like !, ), * etc.

Upgrade from previous version

If you upgrade from a previous version please follow the steps below:

fetch the missing commits from the github repo:
```
git pull
```
run the upgrade script:
```
~/piLogger/bin/upgrade.sh --doIt
```

Notes and references

Data files are found in /var/lib/piLogger
Log files are found in /var/log/piLogger
Config files are found in /etc/piLogger.d, which is conveniently symlinked to ~/piLogger/etc
bash autocompletion is set up for most important scripts. This means that you can press twice to see parameters and devices for most commands in ~/piLogger/bin
By setting the variable debug=true in ~/piLogger/etc/piLogger.conf file, you will get more output on the screen and in the logfiles in /var/log/piLogger
The debug=true can also be set in the URL for more information (i.e device info in the footer), http://your.server.name/?debug=true
You can list your devices at any time by running the following commands, which will NOT alter any config files:
```
~/piLogger/bin/listDevices
~/piLogger/bin/listDevices --aliasFile
```
You can rescan your devices, and automatically update the database with new devices by issuing the following command:
```
~/piLogger/bin/dbTool --scan
```
Copy and paste the output into the terminal window to add the new devices.
Backup / Recovery

Backup to /var/lib/piLogger/backup
```
~/piLogger/bin/backup.sh
```
For a recovery, do a fresh install on new SD card, then copy content of the backup.tgz file into /var/lib/piLogger/db. Run ~/piLogger/bin/refreshCaches
We use SB-Admin 2 as base for the GUI: http://startbootstrap.com/template-overviews/sb-admin-2/

maglub / piLogger

readme