Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

As the title says, I want to pull data from my proxy.

Recently I've got a surge in the amount of data that has to be saved, and the module I'm running at the moment just doesn't cut it*, it generates a html-file filled with styling and stuff (currently I've got more than 200% overhead, which isn't very fun when you've got a data retention plan on over 6 months and 30+ users).

I want to pull as much data as possible from the proxy and insert it into a database (with minimum overhead, . This, I honestly don't know how to do (the pulling from proxy part. I don't need a programming 101 thank you very much).

Any of these (whatever might be the more appropriate):

  • Where does the statistics that sarg display come from (it displays a lot more than what's in the logfiles)?

  • Are there any other source of statistics other than the logfiles (/var/log/squid/access.log | cache.log)?

* sarg

(Go ahead and flag it as "move to SO" if you think it's more appropriate there. I thought this question kinda in the grey, therefore I put it here)

share|improve this question
up vote 0 down vote accepted

Sarg takes all the data from the log files.

If you want to take more information, have a look at the Cache Manager. It has internal information about Squid.

Squid can be configured to send the logs via UDP. I wrote an script that takes information UDP and loads it to a database. It's based in a Turbogears 2 project, but may be it's helpful for you to start.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.