I am trying to start the kafka-mesos framework scheduler using a docker container as provided in https://github.com/mesos/kafka/tree/master/src/docker#running-image-in-marathon using the Marathon implementation launched in minimesos (I would like to add a minimesos label, but not have dots). The application is registered and displayed on the Marathon console, but it remains pending, and the deployment GUI says that it is trying to use ScaleApplication.
I tried looking for / var / log files in the containers of the marathon and the meso-master, which could show why this is happening. Initially, I thought it was possible because the image was not pulled out, so I added "forcePullImage": true to the JSON application configuration, but it is still waiting. I also changed the network from HOST to BRIDGE, based on the assumption that this is consistent with the warnings of minimesos at http://minimesos.readthedocs.org/en/latest/ .
In the mesos magazine, I see:
I0106 20:07:15.259790 15 master.cpp:4967] Sending 1 offers to framework 5e1508a8-0024-4626-9e0e-5c063f3c78a9-0000 (marathon) at scheduler-575c233a-8bc3-413f-b070-505fcf138ece@172.17.0.6 :39111
I0106 20:07:15.266100 9 master.cpp:3300] Processing DECLINE call for offers: [ 5e1508a8-0024-4626-9e0e-5c063f3c78a9-O77 ] for framework 5e1508a8-0024-4626-9e0e-5c063f3c78a9-0000 (marathon) at scheduler-575c233a-8bc3-413f-b070-505fcf138ece@172.17.0.6 :39111
I0106 20:07:15.266633 9 hierarchical.hpp:1103] Recovered ports(*):[33000-34000]; cpus(*):1; mem(*):1001; disk(*):13483 (total: ports(*):[33000-34000]; cpus(*):1; mem(*):1001; disk(*):13483, allocated: ) on slave 5e1508a8-0024-4626-9e0e-5c063f3c78a9-S0 from framework 5e1508a8-0024-4626-9e0e-5c063f3c78a9-0000
I0106 20:07:15.266770 9 hierarchical.hpp:1140] Framework 5e1508a8-0024-4626-9e0e-5c063f3c78a9-0000 filtered slave 5e1508a8-0024-4626-9e0e-5c063f3c78a9-S0 for 2mins
I0106 20:07:16.261010 11 hierarchical.hpp:1521] Filtered offer with ports(*):[33000-34000]; cpus(*):1; mem(*):1001; disk(*):13483 on slave 5e1508a8-0024-4626-9e0e-5c063f3c78a9-S0 for framework 5e1508a8-0024-4626-9e0e-5c063f3c78a9-0000
I0106 20:07:16.261245 11 hierarchical.hpp:1326] No resources available to allocate!
I0106 20:07:16.261335 11 hierarchical.hpp:1421] No inverse offers to send out!
but I'm not sure if this is relevant, as it does not correlate with the resource settings in the configuration of the Kafka application. The graphical interface shows that no tasks have been created.
I have ten mesosphere / inky docker tasks that work along with trying to deploy Kafka. This may be a configuration issue specific to the Kafka docker image. I just don't know how best to debug it. Perhaps this is a case of increasing log levels in the configuration file. This can be an environment variable or network setup. I dig in it and update my progress, but any suggestions will be appreciated.
thanks!
source share