Re: Copy with SCP - low performance
From: Jean-Eric Cuendet (jec_at_rptec.ch)
Date: 03/30/04
- Previous message: Ilja Kogan: "Re: localhost.localdomain"
- Maybe in reply to: Horacio Reyes: "Copy with SCP - low performance"
- Next in thread: Rodolfo J. Paiz: "Re: Copy with SCP - low performance"
- Reply: Rodolfo J. Paiz: "Re: Copy with SCP - low performance"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Date: Tue, 30 Mar 2004 12:28:38 +0200 To: fedora-list@redhat.com
> Horacio Reyes wrote:
>
> >>- The files are copied in batch of 100 tif images, in a directory with
> >>more than 5 million files.
> >>- the server that initiate the scp is a 1.2Ghz P3 with 2G in ram, the
> >>receiver is a double Xeon 2.6ghz with 2G in ram. The first server takes
> >>no time to send the file, but the receiver takes more than 200segs to
> >>copy. They are in a 100mb lan.
> >>- the top comand shows 98% free cpu before the scp, when scp start it
> >>takes 100% of the 2 xeon cpu. The problem is not the ram, both servers
> >>have more than 1G free when scp starts.
> >>
>
> I have found thet SCP does not like lots of small files, if you can tar
> the files together into on big file it will probably transfer much
> quicker..
Do you know a command to tar through SSH which is the same as scp but
kepps better permissions and is quicker?
Here it is:
You have bar/foo and you'd like to copy dir foo to server blabla:
cd bar && tar c foo | ssh user@blabla "cd /dir_on_blabla && tar x"
Great isn't it?
-jec
-- fedora-list mailing list fedora-list@redhat.com To unsubscribe: http://www.redhat.com/mailman/listinfo/fedora-list
- Previous message: Ilja Kogan: "Re: localhost.localdomain"
- Maybe in reply to: Horacio Reyes: "Copy with SCP - low performance"
- Next in thread: Rodolfo J. Paiz: "Re: Copy with SCP - low performance"
- Reply: Rodolfo J. Paiz: "Re: Copy with SCP - low performance"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Relevant Pages
|
|
