[ale] rsync

[Brian Mathis]

Compression won't help for 2 reasons:
1) Image data is already compressed

2) It sounds like you're syncing between local mounts, in which case the
data would be uncompressed before writing to the destination, which is the
local mount, which then sends it over the network.  I hope rsync is smart
enough to ignore the compression option when syncing between local sources.

Compression is only going to help if you're syncing between 2 separate
machines and the data is being transferred over the network by rsync itself
-- not when using a network file system.



❧ Brian Mathis


On Wed, Aug 28, 2013 at 9:40 AM, Edward Holcroft <eholcroft at mkainc.com>wrote:

> I am rsyncing a many files, mostly photos from an EBS volume to an S3
> bucket (locally mounted using FUSE) on AWS.
>
> Given that it's primarily photographic data (jpg), is it still a good idea
> to use compression (z- option), or will I not gain any real benefit by
> trying to compress jpegs?
>
> Alternately, if anyone has a better way of getting 600GB of data from EBS
> to S3, please let me know.
>
> ed
>
> --
> Edward Holcroft | Madsen Kneppers & Associates Inc.
> 3020 Holcomb Bridge Rd. NW | Norcross, GA 30071
> O (770) 446-9606 | M (770) 630-0949
>
> MADSEN, KNEPPERS & ASSOCIATES USA, MKA Canada Inc. WARNING/CONFIDENTIALITY
> NOTICE: This message may be confidential and/or privileged. If you are not
> the intended recipient, please notify the sender immediately then delete it
> - you should not copy or use it for any purpose or disclose its content to
> any other person. Internet communications are not secure. You should scan
> this message and any attachments for viruses. Any unauthorized use or
> interception of this e-mail is illegal.
> _______________________________________________
> Ale mailing list
> Ale at ale.org
> http://mail.ale.org/mailman/listinfo/ale
> See JOBS, ANNOUNCE and SCHOOLS lists at
> http://mail.ale.org/mailman/listinfo
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ale.org/pipermail/ale/attachments/20130828/4d8afc4f/attachment.html>