Re: SATA-performance: Linux vs. FreeBSD

Martin A. Fink wrote:
Am Dienstag, 13. Februar 2007 00:31 schrieben Sie:
Martin A. Fink wrote:
I have to store big amounts of data coming from 2 digital cameras to disk.
Thus I have to write blocks of around 1 MB at 30 to 50 frames per second
for
a long period of time. So it is important for me that the harddisk drive
is
reliable in the sense of "if it is capable of 50 MB/s then it should
operate
at this speed. Constantly."
The good old handful of suggestions:

- Use a dedicated disc for the task.

I used a dedicated disk for this task. No one else besides the task is writing
to it!

OK.

- Use an empty disc so there is no fragmentation.

All tests were performed on empty disk!

OK.

- Buy a bigger disk, they have high bandwidths.

I have a flash disk from a manufacturer who grants me 48 MB/s. And FreeBSD as
well as Windows reach this value. Only Linux 2.6.18 is far away from it (42
MB/s)

Even 48MB/s is quite low.
I've reached up to 70MB/s with a single 500GB Seagate model and even my older HDDs all reach 60MB/s (at least on the outer cylinders)
But i haven't tested any "sync/fsync" in between, only after.

- Buy a more "specialized" disc.

see above

for e.x.: Western Digital Raptor X(*) a 150GB, 10-KRPM S-ATA disc.
- Buy several discs and use RAID 0
or alternate between discs when writing.

What I have to build is an application for the International Space Station
ISS. I am limited with power and space. So If the disk is able to write
constantly 48 MB/s then the Operating System should do this!

OK. That appears to be a serious constraint.
Do HDDs cope well with zero gravity?
At least the SSD won't have a problem with that. ;-)

The problem is: FreeBSD is fast, but lacks of some special drivers. Linux has
all drivers but access to harddisk is unpredictable and thus unreliable!
What can I do??

Personally i haven't had such bad write speeds in years. Taking USB connected and/or encrypted partitions aside.
But on the other hand: I don't sync(fsync) until i have to.
And personally i have good (and constant bandwidth) experience using XFS as a filesystem.
(I have 41 HDDs with a total capacity of 10.5 TB, performance is quite important for me.)

Also you have skipped the information how the images "arrive" on the system (PCI(e) card?), that may be important for an "end to end" view of the problem.

And what's also missing. What is "a long period of time".
Calculating best-case with the SSD:
27GB divided by 30MB/s only gives a bit more than 15 Minutes.
And worst case with 50MB/s is less than 10 Minutes.





--
Real Programmers consider "what you see is what you get" to be just as
bad a concept in Text Editors as it is in women. No, the Real Programmer
wants a "you asked for it, you got it" text editor -- complicated,
cryptic, powerful, unforgiving, dangerous.

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Relevant Pages

  • Re: CD Burning? media and burner questions
    ... CDR and DVDR discs without a single return from a customer ... Note that many brands available on retail shelves are only ... There are some burning programs and disk utilities that will ...
    (rec.audio.pro)
  • Re: 10g RAC: max performance & min cost with miSCSI?
    ... :-) Due to reliability and minimun downtime requirements we are planning to build a 2 node Linux Oracle 10g RAC. ... To minimize the cost we are planning to run the nodes 1 CPU each since Oracle lisences are per CPU. ... The bottleneck seems almost always be on the disk system so starting the design on disk system seems the right way to go. ... Since we have 2 CPUs on RAC the disk system should be able to deliver 400 MB/s, let's say 500 MB/s to be safe. ...
    (comp.databases.oracle.server)
  • 10g RAC: max performance & min cost with miSCSI?
    ... To minimize the cost we are planning to run the nodes 1 CPU each since Oracle lisences are per CPU. ... The bottleneck seems almost always be on the disk system so starting the design on disk system seems the right way to go. ... Since we have 2 CPUs on RAC the disk system should be able to deliver 400 MB/s, let's say 500 MB/s to be safe. ...
    (comp.databases.oracle.server)
  • Re: Help me, a friend of mine wrote a program in C# and I wrote the same program in C..His is faster
    ... DiskIO 300.55 Mb/s ... fwritereturns after putting the data into a buffer but before the hardware actually acknowledges it's been written to disk. ... If an OS don't flush system buffers when a file is closed, or is doing a fflushin an async manner, then it is impossible to code a bullet-proof C program with file I/O, in that environment. ... It's not so amazing when you realize you're measuring the speed of the OS's I/O system, ...
    (comp.lang.c)
  • Re: (S)ATA performance in FBSD 6.2/7.0
    ... I never got beyond 33 MB/s transfer rate although bonni/bonni++ told me both drives are capable doing much more. ... In the first place I thought the older i386 hardware has some hard-limits, but we have several boxes of the exact same hardware around here and a wide spread Linux and Windows utilization and on those boxes equipted with more than one harddrive the effective transfer rate shown up is about 50 - 65 MB/s as expected with copying a big 5G file from one drive to another. ... May I have some knobs I'm not aware of to tune disk performance? ...
    (freebsd-performance)