[ale] Grabbing a dynamic website automatically?

[Christopher R. Curzio]

Run a cronjob with Links outputting the page to a text file?

Something like: "links -dump https://www.foo.bar/page.pl > ~/daily" done
at 0200, perhaps?

-- 
Christopher R. Curzio     |  Quantum materiae materietur marmota monax
http://www.accipiter.org  |  si marmota monax materiam possit materiari?
:wq!

Thus Spake <johncole at mindspring.com>:
Thu, 22 Aug 2002 08:31:36 -0400


> Howdy all!
> 
> What would be the best way to grab the data off of a website that is
> dynamic, HTTPS, and has cookies enabled.?  I'm trying to capture a
> single page everyday from a particular website automatically.
> 
> (in particular I'm using Redhat 7.2)
> 
> I need the page back in text format preferably (or I can convert it to
> text later as needed for insertion into a database.)
> 
> Thanks,
> John
> 
> ---
> This message has been sent through the ALE general discussion list.
> See http://www.ale.org/mailing-lists.shtml for more info. Problems
> should be sent to listmaster at ale dot org.
> 

---
This message has been sent through the ALE general discussion list.
See http://www.ale.org/mailing-lists.shtml for more info. Problems should be 
sent to listmaster at ale dot org.