[ale] wget

[Geoffrey]

Benjamin Dixon wrote:
> 
> Are the other two directories linked from the page you're initially
> grabbing?

No.  So that is the key I guess.  Is there a way to retrieve such a file
tree?

> 
> Ben
> 
> On Mon, 7 Jan 2002, Geoffrey wrote:
> 
> > Christopher Bergeron wrote:
> > >
> > > wget -r -l0 http://url.com/
> >
> > I've tried the following:
> >
> > wget -r -l0 http://url.com/user/
> >
> > under the user directory are three directories and an index.html file.
> >
> > one of the directories is retrieved and the index.html file but not the
> > other two directories.  What gives????
> >
> > >
> > > be careful though, this will traverse _every_ link.  Including ad's and all
> > > thier links.  You've been warned, but hopefully this will help.  I'm certain
> > > the -l flag is what you want, and you can put different levels on it's
> > > "recursivity" (if that's a word).  Check the man page for details, but look
> > > for " -l "
> > >
> > > -CB
> > >
> > > -----Original Message-----
> > > From: esoteric at 3times25.net [mailto:esoteric at 3times25.net]
> > > Sent: Monday, January 07, 2002 7:58 PM
> > > To: ALE
> > > Subject: [ale] wget
> > >
> > > I'm attempting to recursively retrieve a web site using wget.  My
> > > expectation is that it would travel down all the directories trees and
> > > get every file.  I've tried various options, but none seem to do what I
> > > would like.  Clues would be helpful.
> > >
> > > For example if I execute the following:
> > > wget -m www.foo.net/user-dir/
> > >
> > > I was expecting everything under user-dir (directories and there
> > > contents) would be retrieved.  As the -m option includes '-l inf' my
> > > expectation was that it would traverse
> > > www.foo.net/user-dir/dir0/...../dirN/
> > >
> > > Suggestions?
> > >
> > > --
> > > Until later: Geoffrey           esoteric at 3times25.net
> > >
> > > "...the system (Microsoft passport) carries significant risks to users
> > > that
> > > are not made adequately clear in the technical documentation available."
> > > - David P. Kormann and Aviel D. Rubin, AT&T Labs - Research
> > > - http://www.avirubin.com/passport.html
> > >
> > > ---
> > > This message has been sent through the ALE general discussion list.
> > > See http://www.ale.org/mailing-lists.shtml for more info. Problems should be
> > > sent to listmaster at ale dot org.
> >
> > --
> > Until later: Geoffrey         esoteric at 3times25.net
> >
> > "...the system (Microsoft passport) carries significant risks to users
> > that
> > are not made adequately clear in the technical documentation available."
> > - David P. Kormann and Aviel D. Rubin, AT&T Labs - Research
> > - http://www.avirubin.com/passport.html
> >
> > ---
> > This message has been sent through the ALE general discussion list.
> > See http://www.ale.org/mailing-lists.shtml for more info. Problems should be
> > sent to listmaster at ale dot org.
> >
> 
> Today's Random Quote--------------------------------------
> 
>  43rd Law of Computing: Anything that can go wr .signature:
> Segmentation violation -- Core dumped
> 
> -----------------------------------------------------------

--
Until later: Geoffrey		esoteric at 3times25.net

"...the system (Microsoft passport) carries significant risks to users
that
are not made adequately clear in the technical documentation available."
- David P. Kormann and Aviel D. Rubin, AT&T Labs - Research
- http://www.avirubin.com/passport.html

---
This message has been sent through the ALE general discussion list.
See http://www.ale.org/mailing-lists.shtml for more info. Problems should be 
sent to listmaster at ale dot org.