Could you recommend unstructured data indexing software?

Question

I collect magazines from several custom applications. Each application has its own log format. What I'm looking for is a central tool that will allow me to search all my magazines. This means that the tool should be able to define another regular expression (or the like) for each log file (marking where recording starts, ends and what are the fields). I tried Splunk, but I am not happy with this, because the performance is slow, I am limited (free version) with the amount of indexed data per day, and it is not as flexible as I want it to be, could you recommend the software ( preferably free or cheap) for the task?

Answer 1

You can try Lucene . It's free. It is written in Java and allows full-text search of large amounts of data. This is not a complete application, but rather a library, so you need to write code that uses it to index and search your logs. You may need to define different types of documents or at least different indexing functions for your journals, but then the search works beautifully.

Answer 2

If you can use Windows, try using the best Microsoft tool, Logparser . I wish there was such a simple tool for Unix. But no. And although I always wanted to get around creating a version of Logparser for Unix, I just didn't have time.

: - - -!

Answer 3

http://www.splunk.com/

Never used it, but heard about it.