Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have log files that are 500 mb each and there are 200 of such files.

I need to grep certain patterns inside these files. But this takes up a lot of time!

Is there a (open source) software that can index these log files (whatever time it takes in this initial step), and later it can do super quick greps of all the patterns I want?

share|improve this question
OS might help... there is grep for Windows, you know. – Bob Apr 23 '12 at 18:41
I am using cygwin's grep. Are you saying "grep for windows" is any faster? and does it do indexing? – bits Apr 23 '12 at 18:44
I'm just thinking there may be alternative search methods/tools that are OS specific. I'm not too familiar with any, but that could help other answerers. When I said grep for Windows, I was referring to various ports of grep (such as Cygwin's), not a specific program. By your question, your OS is rather ambibious. In fact, when you said grep, I assumed Linux at first. – Bob Apr 23 '12 at 18:50
up vote 3 down vote accepted

Sounds like you need a desktop search engine.

For Linux look here. I have used Recoll, it was generally good. But it sometimes didn't recognise text files correctly.

For Windows I recommend X1, it is excellent and comes with a free trial period.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.