I see extremely slow Solr updates in my database. There are only 900 documents in the database. We use autocommit with the following settings, and from time to time autocomplete takes a lot of time, blocking updates:
<autoCommit>
<maxDocs>10000</maxDocs>
<maxTime>1000</maxTime>
</autoCommit>
What in the world can happen in 74 seconds with 900 documents.
Ideas?
Here is a snippet of the log:
October 18, 2010 11:52:46 org.apache.solr.core.SolrCore execute INFO: [] webapp = / solr path = / update params = {} status = 0 QTime = 59569
October 18, 2010 11:52 : 46 org.apache.solr.update.SolrIndexWriter getDirectory
October 18, 2010 11:53:21 org.apache.solr.core.SolrCore execute INFO: [] webapp = / solr path = / update params = {} status = 0 QTime = 33586
October 18, 2010 11:53 : 21 org.apache.solr.update.processor.LogUpdateProcessor finish
October 18, 2010 11:54:40 org.apache.solr.core.SolrCore execute INFO: [] webapp = / solr path = / update params = {} status = 0 QTime = 76098
October 18, 2010 11:54 : 41 org.apache.solr.update.DirectUpdateHandler2 commit
And commit log:
Oct 18, 2010 11:54:00 AM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start commit (optimize = false, waitFlush = true, waitSearcher = true)
October 18, 2010 11:54:00 org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher @ 29b003 main
Oct 18, 2010 11:54:00 AM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: end_commit_flush
18 2010 . 11:54:00 org.apache.solr.search.SolrIndexSearcher warm
INFO: Searcher @29b003 main Searcher @718c93 main filterCache {= 0 , = 0, hitratio = 0.00, = 512, = 0, = 257, warmupTime = 19294, cumulative_lookups = 3330661, cumulative_hits = 12
5437, cumulative_hitratio = 0,03, cumulative_inserts = 3207537, cumulative_evictions = 3184094}
18 2010 . 11:54:20 org.apache.solr.search.SolrIndexSearcher warm
INFO: Searcher @29b003 main filterCache {= 0 , = 0, hitratio = 0.00, = 256, = 0, = 256, warmupTime = 19739, cumulative_lookups = 3330661, cumulative_hits = 12
5437, cumulative_hitratio = 0,03, cumulative_inserts = 3207537, cumulative_evictions = 3184094}
18 2010 . 11:54:20 org.apache.solr.search.SolrIndexSearcher warm
INFO: Searcher @29b003 main Searcher @718c93 main queryResultCache {= 0 , = 0, hitratio = 0.00, = 256, = 0, = 256, warmupTime = 18604, cumulative_lookups = 3084, = cumulative_hits
996, cumulative_hitratio = 0,32, cumulative_inserts = 2313, cumulative_evictions = 0}
18 2010 . 11:54:40 org.apache.solr.search.SolrIndexSearcher warm
INFO: Searcher @29b003 main queryResultCache {= 0 , = 0, hitratio = 0.00, = 256, = 0, = 256, warmupTime = 19925, cumulative_lookups = 3084, = cumulative_hits
996, cumulative_hitratio = 0,32, cumulative_inserts = 2313, cumulative_evictions = 0}
18 2010 . 11:54:40 org.apache.solr.search.SolrIndexSearcher warm
INFO: Searcher @29b003 main Searcher @718c93 main documentCache {= 0 , = 0, hitratio = 0.00, = 0, = 0, = 0, warmupTime = 0, cumulative_lookups = 41846, cumulative_hits = 33712, cumu
lative_hitratio = 0,80, cumulative_inserts = 8134, cumulative_evictions = 0}
18 2010 . 11:54:40 org.apache.solr.search.SolrIndexSearcher warm
INFO: Searcher @29b003 main documentCache {= 0 , = 0, hitratio = 0.00, = 0, = 0, = 0, warmupTime = 0, cumulative_lookups = 41846, cumulative_hits = 33712, cumu
lative_hitratio = 0,80, cumulative_inserts = 8134, cumulative_evictions = 0}
18 2010 . 11:54:40 org.apache.solr.core.SolrCore registerSearcher
INFO: [] Searcher @29b003 main
18 2010 . 11:54:40 org.apache.solr.search.SolrIndexSearcher