[Tfug] OT : Site Scaper

Eric Gearhart eric at nixwizard.net
Sun May 17 18:33:33 MST 2009


On Sun, May 17, 2009 at 5:43 PM, Judd Pickell <pickell at gmail.com> wrote:
> A less sophisticated way is to do a save as from your file menu in FF or IE.
>
> For a more sophisticated result you probably need a spider app that caches
> the data locally. Have you tried googling for one that runs on windows?

There's a wget for Windows,
(http://gnuwin32.sourceforge.net/packages/wget.htm) and it can spider
sites and mirror them in a way that would provide all the
functionality you need, you just have to rtfm a bit and do a couple of
test runs


You could probably even get crazier than that and wget down your own
site as well, then recursively diff between the two folders...

--
Eric
http://nixwizard.net




More information about the tfug mailing list