Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I'm using Ruby+Watir to request pages through Firefox.

I would like to record the headers and content of every http request made through the browser.

Would it be possible to configure a proxy solution to store this information, either in a file or pipe it into an application?

I'm running Ubuntu x64.

// Edit:

I would like to store the data in logs because I would like to view it later. Preferably, I am looking for a solution that runs quietly in the background and stores the headers/content in files.

share|improve this question
Do you need to save it for later, or do you just want to view the data? – John T Feb 5 '10 at 20:39
up vote 2 down vote accepted

If you have access to a Windows virtual machine or any other Windows physical machine, you can run Fiddler which should do exactly what you want.

After a brief look, I did find a program called Charles which some people refer to as "Fiddler for Linux", but I have no experience using it.

share|improve this answer
Last time I installed Fiddler it installed something called FiddlerHook on FF. Maybe that does what he's looking for? – hyperslug Apr 4 '10 at 13:38

Check Proxy Sniffer - it has free edition.

share|improve this answer

Try to use this Free HTTP Testing tool.

share|improve this answer

Burp Proxy

You can also try the Wireshark sniffer with appropriate filtering options. One general note on Windows self sniffing (sniffing on the loopback device) is that it is hard. But you use Ubuntu so it should work fine.

share|improve this answer

If it's just Firefox you want, you can use the Tamper Data addon to view (and edit) these requests.

share|improve this answer

I use the HttpFox extension for this sort of thing.

alt text

share|improve this answer
Doesn't appear to support logging. – reinierpost Sep 6 '11 at 11:45

You can access the firefox log to trace each http request. It is not done by default. Instructions are available at Mozilla

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .