Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I'm looking for a program to spider a web site* and download the content to disk. I've got the following requirements though which appear to trip up the programs I've tried:

  1. The site's logon process is distributed between multiple pages so I need to be able to start the session manually with my web browser, authenticate, then launch the spider and give it access to the cookies.
  2. Many of the links execute Javascript and then return content.
  3. Many of the links return PDF documents (some spiders do support this).

So far though I'm unable to find a spider that can handle #1 and #2.

* The site is a bill payment service and it has my bill history. I'm looking to stop using the service but I want to keep the history.

share|improve this question

closed as off-topic by random May 16 '15 at 1:12

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • "Questions seeking product, service, or learning material recommendations are off-topic because they become outdated quickly and attract opinion-based answers. Instead, describe your situation and the specific problem you're trying to solve. Share your research. Here are a few suggestions on how to properly ask this type of question." – random
If this question can be reworded to fit the rules in the help center, please edit the question.

up vote 2 down vote accepted

Tennyson Maxwell's Teleport Ultra fulfills your requirements.

share|improve this answer

Not the answer you're looking for? Browse other questions tagged .