Ensure that the following applications are available on the machine:
- Java version 7 or later ( http://openjdk.java.net/install/ )
- Gradle ( http://gradle.org/installation )
To download the Kafka on Mesos project from the repository:
$ git clone https://github.com/mesos/kafka $ cd kafka $ ./gradlew jar
Use this command to download the Kafka executor:
$ wget https://archive.apache.org/dist/kafka/0.10.0.0/kafka_2.10-
0.10.0.0.tgz
Set the following environment variable to point to the libmesos.so file:
$ export MESOS_NATIVE_JAVA_LIBRARY=/usr/local/lib/libmesos.so
Use the kafka-mesos.sh script to launch and configure Kafka on Mesos. But before, create the kafka-mesos.properties file with this contents:
storage=file:kafka-mesos.json master=zk://master:2181/mesos zk=master:2181 api=http://master:7000
These properties are used to configure kafka-mesos.sh so we don't need to pass arguments to the scheduler all the time. The scheduler supports the following...
