Re: Sort files by filename

Les Mikesell wrote:



Is there a reason why rsync cannot be used for this?

Unfortunately, yes, due to the method that I receive the files, ie from another application that has it's own mechanism to feed the files to client machines. I really wish this wasn't the case, but I have to live with what I got.

If you request the resends with http you could use wget with the option to only transfer if the server's copy is newer than yours, and just ask for all of them every time.

Or, if you can construct the (sorted)list of all the names you expect to have you can:

ls * | comm -13 - /path/to/list

and get the list of names in the list but not in the directory.



With apologies to the 2 Les', the situation isn't like that and I apologize if I've not been clear. The application that I'm working with is running on a server that simply relays the data to all our customers, it doesn't store a copy of the files and then feed them. The NWS weather data requires as close to real-time performance and the 'series of tubes' allows. That said, I'm running another server that runs the same application but is designed to pull the data feed and then store the files locally. I /can/ store the files on the primary server, and I have, but this is a production server that feeds 13MB/hr for each of the 60 or so radar sites it handles 24/7 so I don't like asking it to do more than it does.

So, in essence I'm stuck with these files being dumped on a server via a proprietary method. So I need to sort the files and check for missing ones on the filesystem.

The early suggestions were great and I'm trying each one and tweaking to see if I can make them work with what I have. But any additional bash tips would be helpful as I am pressed for an answer to this issue.


--
Recedite, plebes! Gero rem imperialem!


Mark Haney
Sr. Systems Administrator
ERC Broadband
(828) 350-2415

Call (866) ERC-7110 for after hours support

--
fedora-list mailing list
fedora-list@xxxxxxxxxx
To unsubscribe: https://www.redhat.com/mailman/listinfo/fedora-list

Relevant Pages