I am going to start work on a project where we need to process a large amount of data during the day. Basically, since changes occur in our system, we will need to process all units associated with the change. When this happens, we want to give priority to units that have the date closest to today, and then process these units of the week and then the remaining units for the year. As soon as the change occurs, if we process units during the next month, we want to suspend this processing until all of today's units have been processed, and then process the remaining units in priority / date order. It is also advisable that we can balance this across multiple servers. Therefore, before I write a bunch of my own buggy code,is there some kind of open source library or third party library that will handle all this?
source
share