Find the most frequently viewed line from the log file

Question

I want to find the most frequently viewed line in a huge log file. Can someone help me how to do this. one way to do this is to hash each line and calculate the maximum value, but inefficiently. Are there any better ways to do this.

Thanks and respect,

mouse.

Answer 1

If performance is critical, you can look at trie or Radix Tree .

---

, - 50% ( ), - (., ):

• , , 1;
• ,
• 0,
• 2 , .

• 0, , , .

  , .

. , ACM , .

Answer 2

, unix- - :

sort logfile.txt | uniq -c

, - - , , .

, C ++ "", , , , , : -)

Answer 3

( , ), ( , , , , 8 - ASCII) ?

?

Answer 4

""? ""? Unix :

tr -s ' \011' '\012' < /var/log/messages | sort | uniq -c | sort -rn | head -20

    786 --
    635 labrador
    635 Jun
    393 MARK
    236 kernel:
    163 17
    153 usb
    136 22
    118 21
    113 USB
     74 device
     73 20
     73 19
     72 18
     57 5-1:
     51 address
     43 speed
     36 New
     34 0
     33 using

, C, .

Answer 5

, , ( - ), , "" . , , .

stl- . , , , , . stl multiset. .

Answer 6

, - , .

, , , , "the", "a". .

Answer 7

"string" "", , , , .

Answer 8

- , .. , , SOL

, - , . - .

- , . - .

- .

Answer 9

, . perl . perl . perl .