Does Spark support Hash functionality through its cluster?

general contract for hashCodesays

This integer should not remain consistent with one execution of the application on another execution of the same application.

So, for something like Spark, which has separate JVMs for each artist, does it do anything to ensure that the hash codes are consistent in the cluster?

In my experience, I use things with deterministic hashes, so this was not a problem.

+4
source share
1 answer

In my experience, I use things with deterministic hashes, so this was not a problem.

, Spark -.

Java Enums - , , . http://dev.bizo.com/2014/02/beware-enums-in-spark.html. :

... hashCode Java enum type . , , , - JVM ( enum ) - , - Java- , JVM

+6

Source: https://habr.com/ru/post/1683762/


All Articles