atom feed41 messages in ru.sysoev.nginxRe: Image Hosting
FromSent OnAttachments
Indo PhpOct 14, 2010 12:35 am 
yungOct 14, 2010 12:47 am 
SplitIceOct 14, 2010 12:47 am 
SplitIceOct 14, 2010 12:49 am 
Indo PhpOct 14, 2010 1:28 am 
SplitIceOct 14, 2010 1:33 am 
Indo PhpOct 14, 2010 1:47 am 
SplitIceOct 14, 2010 2:07 am 
Dennis JacobfeuerbornOct 14, 2010 5:22 am 
ipta...@yahoo.comOct 14, 2010 5:26 am 
Reinis RozitisOct 14, 2010 5:41 am 
Dennis JacobfeuerbornOct 14, 2010 5:53 am 
Igor SysoevOct 14, 2010 6:03 am 
Igor SysoevOct 14, 2010 6:04 am 
ipta...@yahoo.comOct 14, 2010 6:35 am 
ipta...@yahoo.comOct 14, 2010 6:36 am 
ipta...@yahoo.comOct 14, 2010 6:45 am 
ipta...@yahoo.comOct 14, 2010 6:45 am 
Maxim DouninOct 14, 2010 6:46 am 
Igor SysoevOct 14, 2010 6:46 am 
ipta...@yahoo.comOct 14, 2010 6:56 am 
Maxim DouninOct 14, 2010 7:03 am 
Indo PhpOct 14, 2010 7:25 am 
Indo PhpOct 14, 2010 7:38 am 
Indo PhpOct 14, 2010 7:52 am 
Indo PhpOct 14, 2010 7:53 am 
Dennis JacobfeuerbornOct 14, 2010 7:56 am 
Indo PhpOct 14, 2010 8:05 am 
Maxim DouninOct 14, 2010 10:35 am 
Piotr KarbowskiOct 14, 2010 10:38 am 
Dennis JacobfeuerbornOct 14, 2010 10:42 am 
Ryan MalayterOct 14, 2010 3:07 pm 
ipta...@yahoo.comOct 14, 2010 6:08 pm 
ipta...@yahoo.comOct 14, 2010 6:09 pm 
ipta...@yahoo.comOct 14, 2010 6:10 pm 
ipta...@yahoo.comOct 14, 2010 6:11 pm 
SpliticeOct 14, 2010 10:23 pm 
Indo PhpOct 14, 2010 10:40 pm 
Dennis JacobfeuerbornOct 15, 2010 1:30 am 
Maxime DucharmeOct 26, 2010 2:38 pm 
aqjhOct 27, 2010 6:52 am 
Subject:Re: Image Hosting
From:Maxime Ducharme (ma@techboom.com)
Date:Oct 26, 2010 2:38:11 pm
List:ru.sysoev.nginx

Hi

Thread is quite old for reply but maybe this will help

our setup : - we set blockdev of RAID devices to 4096 - RAID stripe to 256K - scheduler must be set to "deadline" (on Linux see /sys/block/sda/queue/scheduler) - xfs used here with these options : noatime,nobarrier - worker_processes should be equals your number of cores, we have 16 - disable logging - sendfile_max_chunk 512k; - sendfile off; - tcp_nopush on; - tcp_nodelay on; - output_buffers 1 1m; - keepalive_timeout 0;

With this setup we can do 1.7 GBits/s traffic. We are serving bigger files so these wont be ideal for your situation but may be helpful. We have 28TB of data per server.

FYI we do 350 mbytes/s on Treeware/Adaptec SATA RAID. You may try bonnie ++ on this box to see how it can do on plain disk access.

have a nice day

On Thu, 2010-10-14 at 22:41 -0700, Indo Php wrote:

This server is already using ext4 filesystem

______________________________________________________________________ From: Splitice <mat@gmail.com> To: "ngi@nginx.org" <ngi@nginx.org> Sent: Fri, October 15, 2010 12:24:14 PM Subject: Re: Image Hosting

I've heard great things about ext4 and xfs.

Sent from my iPod

What a great result. Could you please be kind to share your configuration?

-----Original Message----- From: Piotr Karbowski <jabb@gmail.com> Date: Thu, 14 Oct 2010 19:38:56 To: <ngi@nginx.org> Reply-To: ngi@nginx.org Subject: Re: Image Hosting

On 10/14/2010 09:36 AM, Indo Php wrote:

hi there,

we have an image hosting, and of course we're using Nginx!

Now on we're having problem with disk i/o. With 200GB of images. Is there any recommendation for this matter? Nginx configuration or Hardware/other software configuration?

We already used Dual Quad Core 3Ghz, 8 GB RAM, 6x73GB 15k SCSI

server

Hi there,

I have something kinda image hosting, almost 220G (651k files, images). Since most users getting quite random content, there is no way cache most used files in ram.

We got best performances with ext4 and bfq io sched, Whole system is gentoo-based etc... so I think you may want try optimize it on OS level.

Dual Core Xeon 2,5GHz, 4G ram and standalone raid10 array, two nginx workers.

-- Piotr.