[ale] 117000 files vs 240 missing - amazon

[Michael Potter]

Also consider if some of the file names are mixed case and may screw up a
count or get overlaid in the transmission.

Also, if you are transmitted from a directory structure into a single
directory and files are getting overlaid.


On Mon, Nov 25, 2013 at 11:27 AM, Sparr <sparr0 at gmail.com> wrote:

> Can you not just get them to send you a list of the files? It probably
> won't be in exactly the same format as your list, but you can easily just
> search and replace to get rid of any indenting, labeling, etc to make them
> match up, then sort and diff them.
>
>
> On Thu, Nov 21, 2013 at 4:59 PM, Lightner, Jeff <JLightner at water.com>wrote:
>
>>   A vendor put a site on Amazon with some files we need.   We don’t have
>> sftp access to this Amazon site but do have ftp access.
>>
>>
>>
>> Accordingly we did a wget to download all the files using our ftp
>> credentials.    When all done we got over 117,000 files and saw no errors
>> in the wget.
>>
>>
>>
>> The problem is vendor is telling our director there are 240 more files in
>> their count than we downloaded.    This is less than a 0.2% difference so I
>> suspect it has something to do with the way they count vs. the way we did.
>> (We used find piped to wc –l.)   Our count matches the summary wget output
>> when it finished so we are sure we’re correctly counting what wget did but
>> of course it’s possible wget actually missed something though it seems
>> unlikely to me.
>>
>>
>>
>> The question is does anyone know what might cause such a difference?
>> Alternative does anyone know another way we could count the files on the
>> Amazon site using our ftp credentials other than going in and counting them
>> one by one?
>>
>>
>>
>> We’re trying to find out how the vendor did their count but I was hoping
>> someone already knows of some vagary on Amazon sites that would cause this
>> kind of discrepancy.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Athena®, Created for the Cause™
>>
>> Making a Difference in the Fight Against Breast Cancer
>>
>>
>>
>>
>>
>>
>> *How and Why I Should Support Bottled Water! *Do not relinquish your
>> right to choose bottled water as a healthy alternative to beverages that
>> contain sugar, calories, etc. Your support of bottled water will make a
>> difference! Your signatures count! Go to
>> http://www.bottledwatermatters.org/luv-bottledwater-iframe/dswaters and
>> sign a petition to support your right to always choose bottled water. Help
>> fight federal and state issues, such as bottle deposits (or taxes) and
>> organizations that want to ban the sale of bottled water. Support community
>> curbside recycling programs. Support bottled water as a healthy way to
>> maintain proper hydration. Our goal is 50,000 signatures. Share this
>> petition with your friends and family today!
>>
>>
>>
>> ---------------------------------
>> CONFIDENTIALITY NOTICE: This e-mail may contain privileged or
>> confidential information and is for the sole use of the intended
>> recipient(s). If you are not the intended recipient, any disclosure,
>> copying, distribution, or use of the contents of this information is
>> prohibited and may be unlawful. If you have received this electronic
>> transmission in error, please reply immediately to the sender that you have
>> received the message in error, and delete it. Thank you.
>> ----------------------------------
>>
>>
>>
>>
>> _______________________________________________
>> Ale mailing list
>> Ale at ale.org
>> http://mail.ale.org/mailman/listinfo/ale
>> See JOBS, ANNOUNCE and SCHOOLS lists at
>> http://mail.ale.org/mailman/listinfo
>>
>>
>
> _______________________________________________
> Ale mailing list
> Ale at ale.org
> http://mail.ale.org/mailman/listinfo/ale
> See JOBS, ANNOUNCE and SCHOOLS lists at
> http://mail.ale.org/mailman/listinfo
>
>


-- 
Michael Potter
  Tapp Solutions, LLC
  Replatform Technologies, LLC
+1 770 815 6142  ** Atlanta ** michael at potter.name  **
www.linkedin.com/in/michaelpotter
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ale.org/pipermail/ale/attachments/20131125/363e96e7/attachment-0001.html>