Re: [ANNOUNCE] Ramback: faster than a speeding bullet



On Saturday 15 March 2008 16:22, Willy Tarreau wrote:
That would have been a miscommunication then. I see arguments coming
in that suggest embedded solutions, EMC for example, are inherently more
reliable than a Linux based solution. Well guess what? Some of those
embedded solutions already use Linux.

But their RAM does not depend on a lot of factors to remain valid and
usable, which is the problem with the common PC.

For example?

Anecdote time. Remember there used to be "brand name" floppy disks and
generic floppy disks, and the brand name ones cost a lot more because
they were supposedly safer? Well, big secret, studies were done and
the no-name disks came out better. Why? Because selling at commodity
prices the generic makers could not afford returns. So they made them
well.

It is like that with PCs. Supposedly you get a lot more reliability
when you spend more money and buy all high end near-custom gear. In
fact, the cheap stuff just keeps on chugging, because those guys can't
afford to have it break.

So please don't underestimate the reliability of a PC.

There are bits of Linux that are undeniably dodgy. We get a lot of bug
reports about usb for example, keyboards just quitting and it's not the
keyboard's fault. Just say no to usb in a server, at least until some
fundamental cleanup happens there.

The worst bug I've seen in a server this year? A buggy bios in a Dell
server that would issue a keyboard error and sit and wait for somebody
to press F1 when there was no keyboard attached. That is embedded
software for you. Personally, I think we do way better than that in
Linux.

Also, peecees are much more reliable than people give them credit for,
especially if you harden up the obvious points of failure such as fans
and spinning disks.

and PSU.

Yes. Dual power supplies are highly recommended for this application.
With dual power supplies you can carry out preemptive maintenance on
the UPS.

Securing every component simply reduces the risk of a loss of service.
What is important with data is to know the consequences of loss of service.
If that only means that no one can work and that the last second of work is
lost, it's generally acceptable. If it means everything is lost to a corrupted
FS, obviously it's not.

So mirror two of them, I keep saying. If that is not good enough for
you, then make it three way, and replicate for good measure. The thing
is, none of that hurts the microsecond level performance, and it gets
you whatever data security you desire. Whereas anything that requires
waiting on disk transactions does hurt performance. Since my interest
currently lies in high performance, that is where my effort goes. And
do I need to say it: patches gratefully accepted.

For my immediate application... hacking the kernel in comfort... just
replicating will provide all the data safety I need.

Sorry if I was not clear. I was not speaking about replacing the RAM with
flash, but only the disks. You keep the RAM for the speed, and use flash
for permanent storage instead of disks. No seek time, average RW speed now
slightly better than disks, that combined with your ramdisk and ordered
write-backs writes will have the best of both worlds : RAM speed and flash
reliability.

Right. What we are talking about is filling in a missing level in the
cache hierarchy, something like:

L1 .3 ns
L2 3 ns
L3 30 ns
Ramdisk 2 us
Flash 20 us
Disk 3 ms

Approximate, numbers not necessarily too accurate, but you know what I
mean. Currently there is this gigantic performance cliff between L3
memory and disk. Something like the Violin ramdisk fills it in nicely.
And see, you still need that rotating media because it always will be
an order of magnitude cheaper than flash. Tape might still fit in
there too, though these days it seems increasingly doubtful.

Daniel
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/



Relevant Pages

  • Re: Flintstone Linux.
    ... I think there's a bug in the Linux video handler (or ... It allows me to configure disks at will, ... > office chair and wake up the screen of one of my two servers. ... > Microsoft are greedy cunts and should be broken up, ...
    (alt.os.linux.suse)
  • Re: OT - Another question. Ping LZ
    ... I just stumbled across "The Ultimate Boot CD" at http://ubcd.sourceforge.net/ which includes 4 programs specifically for cloning, as well as many that can do cloning in addition to other functions. ... It's rather verbose, because I didn't tell you a specific Linux distribution to use, nor do I know exactly how your disks will show up. ... The "mount" command will tell you what's mounted. ...
    (rec.outdoors.rv-travel)
  • Re: OT - Another question. Ping LZ
    ... I just stumbled across "The Ultimate Boot CD" at http://ubcd.sourceforge.net/ which includes 4 programs specifically for cloning, as well as many that can do cloning in addition to other functions. ... It's rather verbose, because I didn't tell you a specific Linux distribution to use, nor do I know exactly how your disks will show up. ... The "mount" command will tell you what's mounted. ...
    (rec.outdoors.rv-travel)
  • Re: software raid0/striping on C: ?
    ... boot loader risks introducing new bugs in a component that must work right ... I'm not commenting on the rightness or wrongness of Windows not supporting ... RAID-0 system disks ... ... >> This raid0/striping on boot/root is way possible, I am a linux guru too, ...
    (microsoft.public.development.device.drivers)
  • Re: Off Topic Linux, newsreaders etc Re: Expert Needed For Paid Interview...
    ... I'm not savy on iso disks and what's entailed in preparing them..I burnt a couple of starter disks that failed so I stopped wasting blanks. ... The best thing that happened to computers and the internet was when Microsoft started placing bounties on anyone connected with malware activities. ... Linux and other open/ free software plus an old computer allow frugal pursuit of the computer hobby. ... It's rock stable, and a very interesting system to learn about, especially the server applications that come with it. ...
    (rec.aquaria.freshwater.misc)