FTP: get recursive directory listing?

1,095 registered users | 0 active users | 0 LpH | Statistics
Login | Create New User

Welcome to IWETHEY!

Post #57,021 by kmself 10/15/02 3:53:49 PM Reply	FTP: get recursive directory listing? Does anyone here know an FTP utility which can generate a recursive directory listing from an arbitrary server (the one I'm crawling is <coff> MacOS9.x </coff>, believe it or not). \r\n\r\n Debian / Linux preferred, natch. I'm looking at `wget`'s options but don't find anything to generate just a directory listing. --\r\nKarsten M. Self [link\|mailto:kmself@ix.netcom.com\|kmself@ix.netcom.com]\r\n[link\|http://kmself.home.netcom.com/\|http://kmself.home.netcom.com/]\r\nWhat part of "gestalt" don't you understand?\r\n[link\|http://twiki.iwethey.org/twiki/bin/view/Main/\|TWikIWETHEY] -- an experiment in collective intelligence. Stupidity. Whatever.\r\n\r\n Keep software free. Oppose the CBDTPA. Kill S.2048 dead.\r\n[link\|http://www.eff.org/alerts/20020322_eff_cbdtpa_alert.html\|http://www.eff.org/alerts/20020322_eff_cbdtpa_alert.html]\r\n
Post #57,027 by kmself 10/15/02 4:35:17 PM Reply	Partial solution: wget I'm ending up spidering the site: \r\n\r\n `\r\nwget -r -c --limit-rate=20k -w 5 --passive-ftp --spider --dont-remove-listing \\ \r\n[link\|ftp://user:pass@foo.bar.com/\|ftp://user:pass@foo.bar.com/]\r\n` \r\n\r\n Not quite what I was looking for, but it seems to work. Prolly a server-side config issue. Note too that they kicked me out (too fast, too many retries?) first time through. \r\n --\r\nKarsten M. Self [link\|mailto:kmself@ix.netcom.com\|kmself@ix.netcom.com]\r\n[link\|http://kmself.home.netcom.com/\|http://kmself.home.netcom.com/]\r\nWhat part of "gestalt" don't you understand?\r\n[link\|http://twiki.iwethey.org/twiki/bin/view/Main/\|TWikIWETHEY] -- an experiment in collective intelligence. Stupidity. Whatever.\r\n\r\n Keep software free. Oppose the CBDTPA. Kill S.2048 dead.\r\n[link\|http://www.eff.org/alerts/20020322_eff_cbdtpa_alert.html\|http://www.eff.org/alerts/20020322_eff_cbdtpa_alert.html]\r\n
Post #57,038 by deSitter 10/15/02 5:30:18 PM Reply	Re: FTP: get recursive directory listing? [link\|http://www.ohse.de/uwe/ftpcopy.html\|http://www.ohse.de/uwe/ftpcopy.html] This package has a program called ftpls that will do what you want. I looked at the FTP RFC and on a cursory exam, didn't find any special cognizance of the need to do a recursive listing. There is the "quote" facility for running remote commands, but for obvious reasons it's a security hazard. -drl

FTP: get recursive directory listing? - (kmself) - (2) - Oct. 15, 2002, 03:53:49 PM EDT

Partial solution: wget - (kmself) - Oct. 15, 2002, 04:35:17 PM EDT

Re: FTP: get recursive directory listing? - (deSitter) - Oct. 15, 2002, 05:30:18 PM EDT

iwethey.org

Red Rover, Red Rover, Bob Lazar's comin' over.
81 ms