Distributed Open Source Projects

Free and Open Source, Distributed, RESTful Search Engine

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

Distributed reliable key-value store for the most critical data of a distributed system

A curated list of awesome remote jobs and resources. Inspired by https://github.com/vinta/awesome-python

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

☁️ Nextcloud server, a safe home for all your data

A scalable, distributed, collaborative, document-graph database, for the realtime web

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

A distributed task scheduling framework.（分布式任务调度平台XXL-JOB）

Consul is a distributed, highly available, and data center aware solution to connect and configure applications across dynamic, distributed infrastructure.

Spring Cloud Alibaba provides a one-stop solution for application development for the distributed solutions of Alibaba middleware.

A standard library for microservices.

A realtime distributed messaging platform

⛔️ DEPRECATED – See https://github.com/ageron/handson-ml3 or handson-mlp instead.

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

Redisson: Valkey & Redis Java Client and Real-Time Data Platform. Sync/Async/RxJava/Reactive API. Over 50 Valkey and Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Bloom filter, Spring, Tomcat, Scheduler, JCache API, Hibernate, RPC, local cache..

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Peace of mind from prototype to production

CNCF Jaeger, a Distributed Tracing Platform

high-performance graph database for real-time use cases

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

A curated list of awesome things related to HarmonyOS. 华为鸿蒙操作系统。

CAT 作为服务端项目基础组件，提供了 Java, C/C++, Node.js, Python, Go 等多语言客户端，已经在美团点评的基础架构中间件框架（MVC框架，RPC框架，数据库框架，缓存框架等，消息队列，配置系统等）深度集成，为美团点评各业务线提供系统丰富的性能指标、健康状况、实时告警等。

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

AI-powered development workspaces with reusable components, architectural clarity and zero overhead.

The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

Distributed transactional key-value database, originally created to complement TiDB

The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

NLTK Source

A hyperparameter optimization framework

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

APM, (Application Performance Management) tool for large-scale distributed systems.

A privacy-aware, distributed, open source social network.

A distributed, fast open-source graph database featuring horizontal scalability and high availability

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

A curated list to learn about distributed systems

open source training courses about distributed database and distributed systems

A distributed transaction framework, supports workflow, saga, tcc, xa, 2-phase message, outbox patterns, supports many languages.

Cloud Native application framework for .NET

YugabyteDB - the cloud native distributed SQL database for mission-critical applications.

Modin: Scale your Pandas workflows by changing a single line of code

Class materials for a distributed systems lecture series

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

A curated list of data engineering tools for software developers

Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm

Peer-to-Peer Databases for the Decentralized Web

Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more

Cloud-Native distributed storage built on and for Kubernetes

Distributed Application Framework for .NET

Enterprise job scheduling middleware with distributed computing ability.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

A framework for distributed systems verification, with fault injection

IPFS implementation in JavaScript

An open source, real-time monitoring system with custom-monitoring, high performance cluster, prometheus-like and agentless.

Distributed SQL database in Rust, written as an educational project

Distributed ID Generate Service

Apache Storm