Kafka: The Definitive Guide Kafka

Kafka%20The%20Definitive%20Guide

User Manual:

Open the PDF directly: View PDF .
Page Count: 322 [warning: Documents this large are best viewed by clicking the View PDF Link!]

Scroll down to view the document on your mobile browser.

Cover
Confluent
Copyright
Table of Contents
Foreword
Preface
- Who Should Read This Book
- Conventions Used in This Book
- Using Code Examples
- O’Reilly Safari
- How to Contact Us
- Acknowledgments
Chapter 1. Meet Kafka
- Publish/Subscribe Messaging
  - How It Starts
  - Individual Queue Systems
- Enter Kafka
- Why Kafka?
- The Data Ecosystem
  - Use Cases
- Kafka’s Origin
- Getting Started with Kafka
Chapter 2. Installing Kafka
- First Things First
- Installing a Kafka Broker
- Broker Configuration
  - General Broker
  - Topic Defaults
- Hardware Selection
- Kafka in the Cloud
- Kafka Clusters
- Production Concerns
- Summary
Chapter 3. Kafka Producers: Writing Messages to Kafka
- Producer Overview
- Constructing a Kafka Producer
- Sending a Message to Kafka
  - Sending a Message Synchronously
  - Sending a Message Asynchronously
- Configuring Producers
- Serializers
- Partitions
- Old Producer APIs
- Summary
Chapter 4. Kafka Consumers: Reading Data from Kafka
- Kafka Consumer Concepts
  - Consumers and Consumer Groups
  - Consumer Groups and Partition Rebalance
- Creating a Kafka Consumer
- Subscribing to Topics
- The Poll Loop
- Configuring Consumers
- Commits and Offsets
- Rebalance Listeners
- Consuming Records with Specific Offsets
- But How Do We Exit?
- Deserializers
- Standalone Consumer: Why and How to Use a Consumer Without a Group
- Older Consumer APIs
- Summary
Chapter 5. Kafka Internals
- Cluster Membership
- The Controller
- Replication
- Request Processing
- Physical Storage
- Summary
Chapter 6. Reliable Data Delivery
- Reliability Guarantees
- Replication
- Broker Configuration
- Using Producers in a Reliable System
- Using Consumers in a Reliable System
  - Important Consumer Configuration Properties for Reliable Processing
  - Explicitly Committing Offsets in Consumers
- Validating System Reliability
- Summary
Chapter 7. Building Data Pipelines
- Considerations When Building Data Pipelines
- When to Use Kafka Connect Versus Producer and Consumer
- Kafka Connect
- Alternatives to Kafka Connect
- Summary
Chapter 8. Cross-Cluster Data Mirroring
- Use Cases of Cross-Cluster Mirroring
- Multicluster Architectures
- Apache Kafka’s MirrorMaker
- Other Cross-Cluster Mirroring Solutions
  - Uber uReplicator
  - Confluent’s Replicator
- Summary
Chapter 9. Administering Kafka
- Topic Operations
- Consumer Groups
- Dynamic Configuration Changes
- Partition Management
- Consuming and Producing
  - Console Consumer
  - Console Producer
- Client ACLs
- Unsafe Operations
- Summary
Chapter 10. Monitoring Kafka
- Metric Basics
- Kafka Broker Metrics
- Client Monitoring
- Lag Monitoring
- End-to-End Monitoring
- Summary
Chapter 11. Stream Processing
- What Is Stream Processing?
- Stream-Processing Concepts
- Stream-Processing Design Patterns
- Kafka Streams by Example
- Kafka Streams: Architecture Overview
- Stream Processing Use Cases
- How to Choose a Stream-Processing Framework
- Summary
Appendix A. Installing Kafka on Other Operating Systems
- Installing on Windows
  - Using Windows Subsystem for Linux
  - Using Native Java
- Installing on MacOS
  - Using Homebrew
  - Installing Manually
Index
About the Authors
Colophon

Kafka: The Definitive Guide Kafka

Kafka%20The%20Definitive%20Guide

Kafka%20The%20Definitive%20Guide

Kafka%20The%20Definitive%20Guide

Navigation menu

Versions of this User Manual:

Views

Navigation