All geek questions in one place

Threads in Java 8: simple solution for using parallelstream () in a cluster?

parallelstream() provides seamless parallelization of operations on a stream through the kernels of one machine.

How can I extend this logic so that parallelstream() distributes these operations to all the machines in the cluster?

Perfectly:
- I create a cluster of machines using the framework

- running myCollection.parallelstream().filter(something).collect() distributes the task to all the kernels of all the cluster machines and returns the result to the machine piloting the cluster.

+6
source share
1 answer

It seems that Spark is doing what you want, i.e. distribute work on nodes. Dsl is similar to java 8 threads. You can also take a look at the acca streams. With akka streams you cannot do what you want, but it offers you a set of tools that will help you with pleasant dsl.

0
source

Source: https://habr.com/ru/post/986864/

More articles:


All Articles