All geek questions in one place

A text editor that can directly search for compressed text files? (only unpacking them in memory)

I have 20 gram (uncompressed) log files. At first they are compressed (as a single file with a size of 70 KB .gz for each log file) and only about 700 MB. I need to scan and find them to diagnose some problems. I don’t know exactly what I’m looking for, and I will probably need to quickly look through several thousand hits for any search that I am trying.

I tried to do this by unpacking all the files and then viewing them using Notepad ++ or Visual Studio. The problem is that searches are terribly slow and put a lot of stress on the hard drive. I assume that for every search I do, it should read all 20 GB from disk.

What could be better if there is a text editor (or the Notepad ++ plugin?) That can search inside .gz files without compressing them to disk. 700 MB of .gz files can easily fit into the system cache, and I assume that compressing each file in memory will be much faster than reading an uncompressed file from disk.

I guess my alternative is to work with just a few gigs at a time, so that it all has a chance to be cached, but that would be pretty inconvenient. Thanks for the suggestions.

+3
source share
2 answers

zlessfrom cygwinshould be able to do this.

+3
source

Combination gunzipand grepcan do this:

gunzip -c *.gz | grep "Search for something"

Available versions for native windows:

http://unxutils.sourceforge.net/

0

Source: https://habr.com/ru/post/1771526/

More articles:


All Articles