LinuxCon+ContainerCon Europe 2016

Developing an end-to-end big data application right from data ingestion, data enrichment and visualisation is a very cumbersome task. In this talk, I will demonstrate how to use Apache Mesos, Marathon, Apache Spark and Docker to build a scalable, fault tolerant, responsive data platform. The result will be a real-time big data application with self-healing features — a dream for every software developer. This talk is a collection of different recipe’s that will help the developer to understand Mesos ecosystem projects and Docker.Choosing the right technologies and tools during the development phase has a major impact on the success of the whole project. Apache Mesos provides the best cluster management system, Marathon gives the feature for long-running applications,Docker allows us to package an application with all of its dependencies into a standardized unit for software development.