I've written a program I'd like to share with everyone. I called it "Pyharvester". Its a Python script which crawls websites and harvests information. Currently, it can harvest the following data:
Its pretty flexible yet easy to use, and I imagine it can be very useful. You can download the zipped source archive here