up vote 0 down vote favorite
share [g+] share [fb]

I am trying to download documents (pdf, tiff, images) from webpages that have javascript and frames in them. example: http://127.0.0.1/web/guest/en/websys/webArch/mainFrame.cgi

'httrack --get-files' didn't download any, are there other ways you may think of? another program? will I have to write that program myself?

Thanks a lot!

link|improve this question
100% accept rate
feedback

2 Answers

up vote 0 down vote accepted

Since that URL ends with "cgi", I would guess that this is running a CGI script on the server -- meaning that it's probably expecting other data. There are a couple of options about where it could be getting this data

First, this other data could come from your logged in session. Look at the docs for wget for the --load-cookies option to specify that it should use the cookie file from your browser (the instructions in my computer are for old browser cookie file formats).

The other option is that it's expecting POST data from your browser. You'll need to figure out what the form variables and values are and pass those using wget's --post-data or --post-file options.

link|improve this answer
Thanks for your answer Doug, but I'm not sure I understand what needs to be done with post-data, could you give me an example? – Zenet Aug 4 '10 at 18:52
You would need to use a tool to examine the data sent when you click on the link in your browser -- Fiddler2 is a good option if you're on Windows. Once you have that you'll need to encode it in a way to pass as POST data -- there's an example in the wikipedia page about POST requests en.wikipedia.org/wiki/POST_(HTTP) – Doug Harris Aug 4 '10 at 19:13
feedback
up vote 1 down vote

Give wget a try.

link|improve this answer
well, I know about wget, but it didn't work well with this URL (I simply used wget without options) – Zenet Aug 3 '10 at 19:48
feedback

Your Answer

 
or
required, but never shown
discard

Not the answer you're looking for? Browse other questions tagged or ask your own question.