Graham Leggett wrote:
Davi Arnaut wrote:
The proxy that the LiveJournal folks wrote, I think, copies all the data
from the origin server into a file and then uses sendfile to send to the
client...
Doesn't this limit the network bandwidth to the bandwidth of the disk
and/or file system?
Yes, and the effective bandwidth of the disk can be significantly higher
than both the cache backend (which is often expensive) and the network
frontend (which has slow potential slow clients typing up your resources).
Don't forget that your cache disk is most often RAM backed, meaning
effectively your cache disk is a ramdisk, with all the speed advantages
that go with it.
This is true for expensive hardware and very well designed operating
systems and file systems.. and the space is not infinite.
But... OK. Back to the topic I thought that one of the key points of
async/event based servers were that we use software to scale and not
hardware (so that hardware is not the bottleneck)... like serving
thousands of slow clients from commodity hardware.