Learning Apache Kafka - Second Edition

Start from scratch and learn how to administer Apache Kafka effectively for messaging In Detail Kafka is one of those systems that is very simple to describe at a high level but has an incredible depth of technical detail when you dig deeper. Learning Apache Kafka Second Edition provides you with step-by-step, practical examples that help you take advantage of the real power of Kafka and handle hundreds of megabytes of messages per second from multiple clients. This book teaches you everything you need to know, right from setting up Kafka clusters to understanding basic blocks like producer, broker, and consumer blocks. Once you are all set up, you will then explore additional settings and configuration changes to achieve ever more complex goals. You will also learn how Kafka is designed internally and what configurations make it more effective. Finally, you will learn how Kafka works with other tools such as Hadoop, Storm, and so on. What You Will Learn Set up both single- and multi-node Kafka clusters and start sending messages Understand the internals of Kafka's design and learn about message compression and replication in Kafka Explore additional settings and configuration changes to achieve ever more complex goals Write Kafka message producers and custom consumers using the Kafka API Integrate Kafka with Apache Hadoop and Storm Integrate Kafka with other tools for logging, packaging, and so on Administer Kafka effectively and consistently with cluster management tools Downloading the example code for this book. You can download the example code files for all Packt books you have purchased from your account at http://www.PacktPub.com. If you purchased this book elsewhere, you can visit http://www.PacktPub.com/support and register to have the files e-mailed directly to you.