Kafka Open Source Projects

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼

【Java面试+Java学习指南】 一份涵盖大部分Java程序员所需要掌握的核心知识。

Apache Kafka - A distributed event streaming platform

阿里巴巴 MySQL binlog 增量订阅&消费组件

Open-source IoT Platform - Device management, data collection, processing and visualization.

一个涵盖六个专栏：Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖，右上角来个 Star，感恩 1024

大数据入门指南 :star:

The Data Engineering Cookbook

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

【大厂面试专栏】一份Java程序员需要的技术指南，这里有面试题、系统架构、职场锦囊、主流中间件等，让你成为更牛的自己！

C++ Parallel Computing and Asynchronous Networking Framework

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

Sarama is a Go library for Apache Kafka.

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

Open-Source Web UI for Apache Kafka Management

2021年最新总结，推荐工程师合适读本，计算机科学，软件技术，创业，思想类，数学类，人物传记书籍

eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

CMAK is a tool for managing Apache Kafka clusters

🚀 fullstack tutorial 2022，后台技术栈/架构师之路/全栈开发社区，春招/秋招/校招/面试

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

A cloud native implementation for Apache Kafka, reducing your cloud infrastructure bill by up to 90%.

Building event-driven applications the easy way in Go.

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

Fancy stream processing made operationally mundane

Kafka library in Go

1200+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..

Free and open log management

goim

一站式云原生实时流数据平台，通过0侵入、插件化构建企业级Kafka服务，极大降低操作、存储和管理实时流数据门槛

『Java八股文』Java面试套路，Java进阶学习，打破内卷拿大厂Offer，升职加薪！

Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern

Java开发者技术书籍大全 - Java入门书籍，Java基础及进阶书籍，框架与中间件，架构设计，设计模式，数学与算法，JVM周边语言，项目管理&领导力&流程，职业素养与个人成长，格局与视野，面试参考书等。

Dockerfile for Apache Kafka

Python Stream Processing

springboot 框架与其它组件结合如 jpa、mybatis、websocket、security、shiro、cache等

现在这个 repo 它已转型为 cxuan-ai-labs：一个普通开发者在 AI 时代的个人实验室，用来记录 AI 文章、工具资源、Agent 实验、模型观察、踩坑复盘，以及一些未必成熟但真实有趣的 AI 作品。旧 Java 内容已归档保留，新主线转向 AI。

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

Kafka Web UI

📌 异步线程池框架，支持线程池动态变更&监控&报警，无需修改代码轻松引入。Asynchronous thread pool framework, support Thread Pool Dynamic Change & monitoring & Alarm, no need to modify the code easily introduced.

Python client for Apache Kafka

Apache Kafka® running on Kubernetes

🚗 个人做过的技术分享... ( topic: 高性能架构, 中间件原理实践，云原生，Golang 等)

Building powerful interactive prompts in Go, inspired by python-prompt-toolkit.

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.

🔥基于go-zero(go zero) 微服务全技术栈开发最佳实践项目。Develop best practice projects based on the full technology stack of go zero (go zero) microservices.

Confluent's Apache Kafka Golang client

【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch

Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

Distributed stream processing engine in Rust

Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.

Java is Growing up but not only Java。Java成长路线，但学到不仅仅是Java。

Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

High-performance open-source in-memory graph database for GraphRAG, AI memory, agentic AI, and real-time graph analytics. Cypher-compatible, built in C++.

Maxwell's daemon, a mysql-to-json kafka producer

PipelineAI

A modern Apache Kafka client for node.js

Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...

A Microservice Toolkit from The New York Times