Re: [SLE] Routing Enormous Traffic for Video Studio

fiber (SAN)
is technically your best solution,

you can agregate the drives by setting up a raid array
and you can gain additional bandwidth by bonding your network connection
but your bottle neck still will be the pci bus speed and your network file
system
other protocols are slower than others

by bonding your network cards would require having a good switch and those
things cost,
a poor mans solution is have a separate network connection between the mac
and file server
that way you would have elliminated all the things that would slow down file
transfer and
optimizes the connection between the two,

but even if you get a gig connection between the two, (which actually runs
between 600-700mb/s)
your drive array wont be able to write data comming in at that speed, you
would need to have a big raid
and raid 0 wont necessarilly help you, for lots of i/o you would need raid
10

and a good motherboard with enough ram to handle the load, 64bit bus iwth
higher clocks is to your advantage

your file system still would be an issue and locking data when accessed by
multiple systems..
GFS would be your ideal solution on raid10 + SAN


in short,

add 1gb network cards to the server and the macs
connect at 1000gb/s full at both ends (use miitools/ethtool to verify that)
use a different ip network for the data hence
-office network 192.168.1.0/24 gw 192.168.1.254
-data network 10.10.10.0/24 use this between the mac and servers for file
transfer

setup your HD with raid 10
use ext3 or jfs but be aware that those are journaling fs with their own
probs
do not use nfs it will cause you lots of headaches especially when it comes
to performance, ill leave this for others to comment ;) but afs would be
better
(do not use appletalk, its one lousy protocol)

that is about as close as you can get,
still a san would be your best solution and most feasable solution if you
are pumping in data at a high rate continously
btw, having more drives is always good :)

regards
RutePoint









On 12/29/05, Andrei Verovski (aka MacGuru) <andreil1@xxxxxxxxxxx> wrote:
>
> Hi,
>
> Anyone had and experience (or just ideas) how to use Linux server in video
> studio for sharing RAID between 3 - 4 Power Mac workstations, taking into
> account enormous traffic generated by video capture and editing?
>
> One solution is to use Apple XRaid, XSan, and 2 XServe (1 pc will work,
> but 2 pcs are better, one is used for routing traffic, second for data
> transfer).
> Unfortunately, this is OUT of budget (Fibre Channel SAN system is not a
> solution for a project with strict budget).
>
> My idea is to use 3Ware Escalade Card (with 8x500 GB HDs formatted as 4
> Level-0 RAIDs), installed into Linux box, and 4-port Gigabit Ethernet Card.
> The question is how to organize traffic routing between this Linux box and 4
> PowerMacs (all of them have Gigabit Ethernet on-board), so each Mac could
> see every RAID, yet passing exclusively all traffic through defined Ethernet
> port on server (in order to avoid Ethernet link saturation and video frame
> dropout)? Additionally, all Macs should see each other.
>
> Phew, complex and unusual, but that is a challenge :-))
>
> Thanks in advance for any suggestion(s).
>
>
> ************************************************
> *** with best regards
> *** Andrei Verovski (aka MacGuru)
> *** Mac, Linux, DTP, Programming Web Site
> ***
> *** http://snow.prohosting.com/guru4mac/
> ************************************************
>
> --
> Check the headers for your unsubscription address
> For additional commands send e-mail to suse-linux-e-help@xxxxxxxx
> Also check the archives at http://lists.suse.com
> Please read the FAQs: suse-linux-e-faq@xxxxxxxx
>
>
>


--
___________________________

If computers were made in heaven,
would they be perfect?
___________________________

Relevant Pages

  • Re: Multi-Channel Raid VS SAN Storage
    ... A 5~6 years old server is a very old server. ... As I mentioned, the server is one node in a cluster environment, and SQL is ... We actually are running RAID 1+0 and our aplication is definately more ... needs it's own SAN device, or at least a dedicated IO channel on the SAN. ...
    (microsoft.public.sqlserver.setup)
  • Re: Multi-Channel Raid VS SAN Storage
    ... A 5~6 years old server is a very old server. ... As I mentioned, the server is one node in a cluster environment, and SQL is ... We actually are running RAID 1+0 and our aplication is definately more ... needs it's own SAN device, or at least a dedicated IO channel on the SAN. ...
    (microsoft.public.sqlserver.setup)
  • Re: Add new cluster and use existing LUNs?
    ... Storport driver and Powerpath on all of our SAN host servers so we are trying ... In the end I think that I may play it cautious and create a new RAID group, ... > varied activity (DBMSes, Messaging Server, File Server, Web Servers, ... Some of the physical spindle limitations can be addressed through the SAN ...
    (microsoft.public.sqlserver.clustering)
  • Re: Shared storage question.
    ... "A SAN is also referred to as a Storage Area Network. ... network-attached storage server is attached to another server through the ...
    (microsoft.public.windows.server.clustering)
  • Re: Multi-Channel Raid VS SAN Storage
    ... The server itself is about 5 and a half years old. ... As I mentioned, the server is one node in a cluster environment, and SQL is ... We actually are running RAID 1+0 and our aplication is definately more ... needs it's own SAN device, or at least a dedicated IO channel on the SAN. ...
    (microsoft.public.sqlserver.setup)
Loading