Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I have a very big text file (10 GB). Both Notepad and Notepad++ tell me that the file is too big for them to open. What editor can handle such a large file? It's a log file.

share|improve this question

closed as not constructive by slhck May 29 '13 at 10:20

As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.If this question can be reworded to fit the rules in the help center, please edit the question.

1  
Most text editors put the entire files into RAM, so unless you have over 10GB of RAM, you're going to have a hard time finding a good text editor that does this. That said, I'm positive one exists. –  Sasha Chedygov Sep 3 '09 at 5:46
21  
That's one heck of a text file –  Col Sep 3 '09 at 7:28
6  
@NoCanDo - I would guess a log file of some kind, or a data file for processing. –  ldigas Sep 6 '09 at 14:15
1  
Is there any unuseful information in your file that can be parsed out of it to make your file smaller? –  ralford Dec 13 '09 at 23:48
show 4 more comments

24 Answers

up vote 43 down vote accepted

If you only need to read the file, I can suggest Large Text File Viewer.

share|improve this answer
2  
Sorry -1. This wasn't a very good editor. It froze up when opening a 7MB file. –  DJTripleThreat Feb 10 '11 at 19:26
19  
+1. Worked for a 90GB xml file. –  timbooo May 13 '11 at 8:43
7  
oh yeah? Notepad was designed to play 5.4TB HD videos as well. I can say that too. Doesn't mean it will do that though. –  DJTripleThreat May 22 '11 at 21:09
1  
I won't downvote this answer because Large Text File Viewer does open very large files, BUT this is definitely not the best solution. Based on this answer I used Large Text File Viewer for viewing large log files (excess of 2 Gb) and although it opened them, searching was very slow. I then tried V - The File Viewer mentioned in an answer lower down and that was extremely fast... searches for text in a 2Gb file in a matter of seconds. V definitely gets my vote. –  BruceHill Oct 24 '12 at 21:15
show 6 more comments

Stack Overflow ref Text editor to open big (giant, huge, large) text files.

Vim is a personal favorite.

  • However, if you are working with timestamped entries in log file, it's easier to filter for a date range and look at smaller files.
  • With other kinds of larger files, you could cut out specific line-number ranges (tools like sed and grep) to smaller files and analyze individually
  • If it's some specific translation or searching to do, again sed, grep, etc. are good tools.
share|improve this answer
show 4 more comments

UltraEdit is your best bet - I've opened files that were a few gigabytes in size with it. They also have some tips on opening large files.

It's not free, however.

Otherwise, you can use the Unix split utility from the command line - should be included in Cygwin or the Linux command line tools for Windows. You'll have much better luck dealing with the files if you've split them up into smaller chunks.

share|improve this answer
3  
I have used Ultraedit to open files that were nearly a hundred gigabytes large with no problems whatsoever. It works well. –  BBlake Mar 30 '10 at 12:18
show 3 more comments

The best one I tried was V - The File Viewer, when I needed to analyse a text file of more than 1 TB. It was by far the fastest. It's not free, though ($20).

share|improve this answer
show 1 more comment

EmEditor is a very nice editor all around, but also build with opening very large files in mind.

From their site, and I quote: " EmEditor Text Editor is a lightweight, yet extendable, easy-to-use text editor for Windows. EmEditor is very customizable, and it supports Unicode and powerful macros. EmEditor now supports very large files - up to 248 GB or 2.1 billion lines! EmEditor is certified for Windows Vista! The x64 Edition is also available! The portable version is also available for USB drive setup! "

share|improve this answer
1  
This was the only program that could reliably open my 32GB CSV files. –  Robert H Jan 8 '13 at 18:37
show 2 more comments

Total Commander's lister can open very large files for reading. For editing you might also use some kind of Hex editor (like the free HxD), they can usually open and edit large files.

share|improve this answer
show 2 more comments

The Unix sed (stream editor) command can handle files of an arbitrary large (even infinite) file size, because it applies a script of editing commands to the stream of lines that pass through it. You can easily get it for Windows through the Cygwin distribution.

For instance, if you want to delete all files containing the string foo you write in the command prompt:

sed /foo/d <inputfile >outputfile

To substitute foo with bar write:

sed s/foo/bar/ <inputfile >outputfile

More complicated constructions are possible. Someone has even written a script to have sed solve the Towers of Hanoi puzzle.

share|improve this answer
show 3 more comments

I've had luck with TextPad on files 2 GB in size with less ram than that, it takes a while to load up, but it works.

share|improve this answer
3  
It feature list implies that it does load the file into memory, even if it is virtual memory: "It can handle file sizes up to the largest contiguous chunk of 32-bit virtual memory." –  dlamblin Sep 6 '09 at 21:34
3  
It cannot handle files with larger size than avaible memory. –  Berk Demirkır Sep 22 '11 at 12:52
show 3 more comments

I have developed a Unicode editor called GigaEdit specifically to solve this issue of opening unlimited size files instantly by blocks of 1 MB with scrollbar to navigate effortlessly between blocks and a multi-threaded search feature that displays a result as they become available and allows you to go to matches instantly F3 or Shift+F3 even across blocks transparently.

WARNING: There is no UNDO after saving so make sure you know what you are doing.

share|improve this answer
add comment

For looking through large files (but only for read-only purposes), I use a Windows port of the UNIX less utility. It generally loads up any large file very quickly, and is pretty quick at searching for text patterns (once you get past its learning curve).

(Oh, and the other catch is that you have to run it within a command prompt window. It might not work if you were looking for something a bit more visually friendly.)

I don't recall where I found my current copy of it, but a quick web search shows a few possible places to download one, e.g.:

share|improve this answer
add comment

I would recommend VEDIT. It is about the only editor that is fast enough to realistically edit huge files. Its engine has been written in highly optimized assembly language.

No matter how big the file, VEDIT loads it in a fraction of a second (typically about 0.1 second). Most editors load the whole file in memory, which limits the file size and slows down opening the file. VEDIT only loads a part of the file at a time, and does not create a huge temporary file when opening the file (temporary files are created only when needed and as big as needed). In addition, VEDIT uses very little of computer memory. When I had a 300 MB file open, Task Manager reported 4.5 MB memory usage for VEDIT.

If you are just viewing the file and not editing, opening the file in read-only mode (with Fast Browse Mode enabled) makes VEDIT even faster. For example, you can scroll to any location in the file instantly, without any delay.

The standard (32-bit) version of VEDIT can handle files up to 2 GB. VEDIT Pro64 can handle files of any size.

To edit files larger than 2 GB on a 32-bit editor, you can split the file into smaller parts. You could use a separate tool for that, but VEDIT has built-in function to split and combine such files. For huge log files, splitting might be good idea anyway. You can then open all the parts for editing simultaneously and you can perform global searches among all of them, etc.

share|improve this answer
add comment

I had trouble loading a 5.5 GB binary file in a whole range of editors. Two I found that worked, and opened the file instantly:

HxD is my preferred one, since it is free, supports viewing and editing and is a stand alone. My large files are generally binary, so a hex editor is fine. But for viewing large text files, Altap Salamander has a better viewer.

share|improve this answer
add comment

I edited a file of 7 GB with PilotEdit. But it may take you an hour to open/save a 10 GB file. After you open the file, you can edit it quickly.

share|improve this answer
add comment

Under Windows, I use EditPad Pro from Just Great Software (there is a lite version too).

EditPad is the best editor I found. TextPad is also very good. Both now support UTF-8 file encoding.

share|improve this answer
add comment

I used to like pepper for this purpose. It's a little hard to find the abandoned windows port, and harder still to get it registered, though I managed about 2 years ago to contact Hekkelman about it. One of the features is that it does not load the whole file into memory.

share|improve this answer
show 1 more comment

EmEditor is basically built for huge files. It's never balked at anything I'm thrown at it!

share|improve this answer
1  
If you want to advertise your product, I recommend you do so by contacting the team. You can buy advertisements to put on side, or even better, sponsor a tag (like text-editor). The point is, if you really want to advertise, that's the best way. Because if you keep doing it by poking all related questions and adding link to your product, you will be seen as spammer. And this rarely ends good. That said, have a good day, enjoy your stay around here, provide useful answers. –  Gnoupi Jul 31 '10 at 7:09
add comment

If you only want to view a section of a file, then you can use the following command in a DOS window.

type reallylargefile.txt | more

This will display file at a screen full at a time.

share|improve this answer
1  
or just more reallylargefile.txt –  newenglander Jul 29 '11 at 7:59
add comment

Assuming you only need to read the file, Microsoft's Windows 2003 resource kit includes list.exe.

share|improve this answer
add comment

Try TextPad. It's the best.

  • Huge files can be edited, up to the limits of 32-bit virtual memory. See Specifications for the actual limits.

And then per the [Specifications]

  • It can handle file sizes up to the largest contiguous chunk of 32-bit virtual memory.
  • The number of concurrent edits is limited by available Windows resources.
share|improve this answer
show 1 more comment

One approach is to break the giant file into smaller files. You can do that with Chainsaw. It takes a file of any size and outputs a bunch of smaller files from it.

share|improve this answer
add comment

Use FileSplitter to break the file into smaller files, and then use your favorite text editor!

Description: The File Splitter is a free Windows program that will split any file into pieces of any size and later combine the pieces to form the original file.

share|improve this answer
add comment

One very good editor for large files is Programmer's File Editor. I use it to ope files bigger than 15GB.

share|improve this answer
add comment

protected by nhinkle May 22 '11 at 8:15

Thank you for your interest in this question. Because it has attracted low-quality answers, posting an answer now requires 10 reputation on this site.

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.