Kafka documents (contents)

Time:2020-10-24

Kafka documentation

Apache Kafka? Is a distributed streaming platform: publish and subscribe to record streams, similar to message queuing or enterprise messaging systems, store record streams in a fault-tolerant and persistent manner, and process them when they occur.

1. Introduction

  • 1.1 INTRODUCTION
  • 1.2 use cases
  • 1.3 quick start
  • 1.4 ecosystem
  • 1.5 upgrade

2. API

  • 2.1 Producer API
  • 2.2 Consumer API
  • 2.3 Streams API
  • 2.4 Connect API
  • 2.5 AdminClient API
  • 2.6 Legacy APIs

3. Configuration

  • 3.1 broker configuration
  • 3.2 topic configuration
  • 3.3 producer configuration
  • 3.4 consumer configuration
  • 3.5 Kafka connect configuration
  • 3.6 Kafka streams configuration
  • 3.7 adminclient configuration

4. Design

  • 4.1 motivation
  • 4.2 persistence
  • 4.3 efficiency
  • 4.4 Producer
  • 4.5 Consumer
  • 4.6 message passing semantics
  • 4.7 response
  • 4.8 log compression
  • 4.7 disk quota

5. Implementation

  • 5.1 network layer
  • 5.2 message
  • 5.3 message format
  • 5.4 log
  • 5.5 distribution

6. Operation

  • 6.1 basic Kafka operation
  • 6.2 data center
  • 6.3 important configuration
  • 6.4 java version
  • 6.5 hardware and operating system
  • 6.6 monitoring
  • 6.7 ZooKeeper

7. Safety

  • 7.1 safety overview
  • 7.2 use SSL for encryption and authentication
  • 7.3 validation using SASL
  • 7.4 authorization and ACL
  • 7.5 merging security features in a running cluster
  • 7.6 zookeeper authentication

8. Kafka connection

  • 7.1 general
  • 7.2 User Guide
  • 7.3 connector development guide

9. KAFKA stream

  • 9.1 using streaming applications
  • 9.2 write your own streaming application
  • 9.3 developer manual
  • 9.4 core concepts
  • 9.5 architecture
  • 9.6 upgrade Guide