Save rotated nginx log files with the actual date in the file name

[carribeiro]

Nginx log files are stored in the cdnservers and contain all the information about access to the video files. This information is needed to calculate the volume of transfer, that in turn is how we charge our customers (TB/month). We need to retrieve all the log information from the cdnservers and put in into the cdmanager for billing and other purposes.

We need to make sure that we never miss a log file and also, that we never collect a log file twice. One single way to make it work is to save the date of the file in the filename. The logrotate then automatically rotates and compresses the file, saving it with the day of the rotation.

Note:

• logrotate has a dateext option
• the standard is to compress only from the second day on. We should compress it on the first day to reduce transfer size.
• Remember to modify the fabfile so the changes to the logrotate configuration are done at server setup!

References:

• http://www.ducea.com/2006/06/06/rotating-linux-log-files-part-2-logrotate/
• http://linux.die.net/man/8/logrotate
• http://www.thegeekstuff.com/2010/07/logrotate-examples/

[akostyuk]

I added a new fabfile which uses cuisine to install nginx. You will need to pass options to the command line: fab variables:'10.7.1.5',user='deploy' install_nginx

[carribeiro]

Should it be:

fab variables:hosts='10.7.1.5',user='deploy' install_nginx

??

On Wed, Jun 8, 2011 at 16:32, akostyuk < reply@reply.github.com>wrote:

I added a new fabfile which uses cuisine to install nginx. You will need to pass options to the command line: fab variables:'10.7.1.5',user='deploy' install_nginx

Reply to this email directly or view it on GitHub: https://github.com/carribeiro/vdeli/issues/47#comment_1329222

Carlos Ribeiro Consultoria em Projetos twitter: http://twitter.com/carribeiro blog: http://rascunhosrotos.blogspot.com mail: carribeiro@gmail.com

[akostyuk]

No, it is just the example. You will need to run it:

fab install_nginx

and it will ask you a host on which you want to processed the action. You can pass it to the variables, like this:

fab variables:hosts='10.1.1.1, 10.2.2.2, 10.3.3.3', user='deploy' install_nginx