Assault warders, memory allocation workers

I have an assault cluster with 3 nodes: supervisors-2, Nimbus-1. 3 nodes have 30 GB of RAM and 4 processors. In the configurations, I configured:

supervisor.slots.ports : 8 (6700-6708)
supervisor.childopts  :-Xmx4096m _JAAS_PLACEHOLDER 
ui.childopts :-Xmx1024m _JAAS_PLACEHOLDER
nimbus.childopts :-Xmx6144m _JAAS_PLACEHOLDER 

I want to know:

  • How do these slots affect supervisor nodes? In my opinion, for each node supervisor we assign 8 ports. So how many workers will I get for the cluster?
  • For the childopts controller, it is configured with 4 GB of RAM. what does it mean? similar to nimbus childopts?
  • Suppose that if I use a topology with three workers in this configuration, which Ram and processor cores are used? How to calculate the use of RAM and CPU utilities for a particular topology
+4
source share
2 answers
  • 8 → 8 . .
  • supervisor.childopts . nimbus.childopts.
  • . - . / .
+2

( ) (/) node, . , node , .

setMemoryLoad (Number onHeap):

builder.setBolt("exclaim1", new ExclamationBolt(), 3)
        .shuffleGrouping("word").setMemoryLoad(512.0);

setCPULoad (Double amount):

builder.setBolt("exclaim2", new HeavyBolt(), 1)
            .shuffleGrouping("exclaim1").setCPULoad(450.0);

storm.yaml

supervisor.memory.capacity.mb: [amount<Double>]

supervisor.cpu.capacity: [amount<Double>]

, ,

0

Source: https://habr.com/ru/post/1627300/


All Articles