Reindex high load search engine

Maybe someone can share their experience on how to solve such problems. I would be glad to know from you.

In short: we have a huge Rails application with ReactJS and Solr as a search engine (Sunspot gem). Therefore, our problem is that you update an object and set the task to re-view this object in the queue (Sidekiq), it takes up to 3 seconds to complete the redefinition of the object. And the user can see this object in lists, where it should no longer be. When using reindex synchronous calls without a queue, there may be a potential problem with loss of tasks in case of high load.

How do you design your architecture to solve such problems?

+4
source share

Source: https://habr.com/ru/post/1671998/


All Articles