Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have log files that are 500 mb each and there are 200 of such files.

I need to grep certain patterns inside these files. But this takes up a lot of time!

Is there a (open source) software that can index these log files (whatever time it takes in this initial step), and later it can do super quick greps of all the patterns I want?

share|improve this question
OS might help... there is grep for Windows, you know. – Bob Apr 23 '12 at 18:41
I am using cygwin's grep. Are you saying "grep for windows" is any faster? and does it do indexing? – bits Apr 23 '12 at 18:44
I'm just thinking there may be alternative search methods/tools that are OS specific. I'm not too familiar with any, but that could help other answerers. When I said grep for Windows, I was referring to various ports of grep (such as Cygwin's), not a specific program. By your question, your OS is rather ambibious. In fact, when you said grep, I assumed Linux at first. – Bob Apr 23 '12 at 18:50
up vote 3 down vote accepted

Sounds like you need a desktop search engine.

For Linux look here. I have used Recoll, it was generally good. But it sometimes didn't recognise text files correctly.

For Windows I recommend X1, it is excellent and comes with a free trial period.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .