[ale] Parallel data stansfers (NFS).

[JD]

On 11/05/2014 10:53 AM, Raj Wurttemberg wrote:
> Looking for some advice on parallel data transfers in Linux.
> 
> We regularly get large amounts of data to import into a development
> environment. Usually about 10TB but the data is in many files.
> 
> Is there a command line utility to copy several files at once? It's usually
> 100+ files so I really can't specify a file name.  I like the way FileZilla
> copies files but we don't need SFTP or FTP since we are copying directly to
> NFS.
> 


I'd use rsync and be done. Be certain to RTFM about rsync and local copies (they
always copy the file). NFS appears to rsync as local storage.  I routinely see
65+MB/s (520 Mbps) transfers.

10G really isn't much data - just 5-10 min to transfer.