24 messages in ru.sysoev.nginxRe: Centralized logging for multiple ...
FromSent OnAttachments
Kingsley ForemanApr 12, 2009 8:26 pm 
Anton YuzhaninovApr 13, 2009 11:46 am 
Gena MakhomedApr 13, 2009 12:31 pm 
Igor SysoevApr 15, 2009 6:12 am 
Glen LumanauApr 15, 2009 6:23 am 
Dave CheneyApr 15, 2009 6:32 am 
Kingsley ForemanApr 15, 2009 6:35 am 
Glen LumanauApr 15, 2009 6:35 am 
Dave CheneyApr 15, 2009 7:06 am 
Kon WilmsApr 15, 2009 8:40 am 
Michael ShadleApr 15, 2009 8:43 am 
W. Andrew Loe IIIApr 16, 2009 7:37 pm 
Gabriel RamugliaApr 16, 2009 8:41 pm 
W. Andrew Loe IIIApr 16, 2009 8:54 pm 
Michael ShadleApr 16, 2009 9:08 pm 
Gabriel RamugliaApr 17, 2009 3:32 am 
Michael ShadleApr 17, 2009 8:42 am 
Gabriel RamugliaApr 17, 2009 10:36 am 
Gabriel RamugliaApr 17, 2009 10:52 am 
Gabriel RamugliaApr 17, 2009 5:06 pm 
Kon WilmsApr 17, 2009 6:02 pm 
Gabriel RamugliaApr 18, 2009 2:22 am 
Kon WilmsApr 18, 2009 9:15 am 
Gabriel RamugliaApr 18, 2009 12:02 pm 
Actions with this message:
Paste this link in email or IM:
Paste this link in email or IM:
Atom feed for this thread
Paste this URL into your reader:
Subject:Re: Centralized logging for multiple serversActions...
From:Dave Cheney (da@cheney.net)
Date:Apr 15, 2009 7:06:32 am
List:ru.sysoev.nginx

What about

cat *.log | sort -k 4

On 15/04/2009, at 11:36 PM, Glen Lumanau wrote:

Yes I already used it. But it seems taking too much resources

Is there any other way that we can merge this logs?

------Original Message------ From: Dave Cheney Sender: owne@sysoev.ru To: ngi@sysoev.ru ReplyTo: ngi@sysoev.ru Subject: Re: Centralized logging for multiple servers Sent: Apr 15, 2009 8:32 PM

Awstats comes with a small perl file to merge multiple log files which I have used in the past

/usr/bin/logresolvemerge.pl

Cheers

On 15/04/2009, at 11:23 PM, Glen Lumanau wrote:

Then how can we join those logs that's sent to central host?

------Original Message------ From: Igor Sysoev Sender: owne@sysoev.ru To: ngi@sysoev.ru ReplyTo: ngi@sysoev.ru Subject: Re: Centralized logging for multiple servers Sent: Apr 15, 2009 8:12 PM

On Mon, Apr 13, 2009 at 12:56:29PM +0930, Kingsley Foreman wrote:

Hi guys,

Just wondering what you guys are using for centralized logging of access logs for multiple servers. I'm thinking about using the syslog patch but I was wondering if anyone was using anything they think is better? And has piping of log files been implemented in the newer versions?

I personally do not like syslog and log piping.

I prefer to writing to local file system and to scp logs at midnight to central host.

Some time ago I needed to deliver logs for hourly statistics. I have made script that rotates log every hour, then gzips it (it takes several seconds as a whole ~1G hourly log file is in VFS cache), and sends the log to host. A daily log is done as

zcat hourly-logs.gz | 7z > daily-log.7z

and then it is copied to central host.

-- Igor Sysoev http://sysoev.ru/en/

Best Regards,

Glen Lumanau - Sent from my BlackBerry®

Best Regards,

Glen Lumanau - Sent from my BlackBerry®