I'm using Ruby+Watir to request pages through Firefox.

I would like to record the headers and content of every http request made through the browser.

Would it be possible to configure a proxy solution to store this information, either in a file or pipe it into an application?

I'm running Ubuntu x64.

// Edit:

I would like to store the data in logs because I would like to view it later. Preferably, I am looking for a solution that runs quietly in the background and stores the headers/content in files.

link|improve this question

1  
Do you need to save it for later, or do you just want to view the data? – John T Feb 5 '10 at 20:39
feedback

6 Answers

up vote 2 down vote accepted

If you have access to a Windows virtual machine or any other Windows physical machine, you can run Fiddler which should do exactly what you want.

After a brief look, I did find a program called Charles which some people refer to as "Fiddler for Linux", but I have no experience using it.

link|improve this answer
Last time I installed Fiddler it installed something called FiddlerHook on FF. Maybe that does what he's looking for? – hyperslug Apr 4 '10 at 13:38
feedback

Check Proxy Sniffer - it has free edition.

link|improve this answer
feedback

Try to use this Free HTTP Testing tool.

link|improve this answer
feedback

Burp Proxy

You can also try the Wireshark sniffer with appropriate filtering options. One general note on Windows self sniffing (sniffing on the loopback device) is that it is hard. But you use Ubuntu so it should work fine.

link|improve this answer
feedback

If it's just Firefox you want, you can use the Tamper Data addon to view (and edit) these requests.

link|improve this answer
feedback

I use the HttpFox extension for this sort of thing.

alt text

link|improve this answer
Doesn't appear to support logging. – reinierpost Sep 6 '11 at 11:45
feedback

Your Answer

 
or
required, but never shown

Not the answer you're looking for? Browse other questions tagged or ask your own question.