Redshift Open Source Projects

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

Apache Doris is a real-time analytics and hybrid search database for AI agents.

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

Python SQL Parser and Transpiler

Open Source Feature Flags, Experimentation, and Product Analytics

The leader in Customer Data Infrastructure

Redshift adjusts the color temperature of your screen according to your surroundings. This may help your eyes hurt less if you are working in front of the screen at night.

Free, open-source SQL client for Windows and Mac 🦅

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

Privacy and Security focused Segment-alternative, in Golang and React

tbls is a CI-Friendly tool to document a database, written in Go.

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Fluent migrations framework for .NET

Database Subsetting and Relational Data Browsing Tool.

Object Relational Mapping

Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Simple SQL Client for lightweight data analysis.

db.py is an easier way to interact with your databases

AdonisJS SQL ORM. Supports PostgreSQL, MySQL, MSSQL, Redshift, SQLite and many more

Scratch is an open-source alternative to BigQuery, Redshift, and Snowflake. Runs on Clickhouse.

Personal Data Engineering Projects

Dataform is a framework for managing SQL based data operations in BigQuery

Better SQL in Jupyter. 📊

A list command for AWS resources

Rich SQL client for Postgresql, MySQL, MS SQL, Amazon Redshift, Google Firebase (Firestore)

Synmetrix – open source semantic layer / Boost your LLM precision

Redshift data source for Apache Spark

Amazon Redshift Database Loader implemented in AWS Lambda

Beginner data engineering project - batch edition

A tool for cleaning your AWS account

Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.

Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!

Transition-based statistical parser

Metrics Observability & Troubleshooting

AWS Lambda function to forward Stream data to Kinesis Firehose

CLI tool for dbt users to simplify creation of staging models (yml and sql) files

Amazon Redshift Advanced Monitoring

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.

A collection of example UDFs for Amazon Redshift.

Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases

Snowflake Data Source for Apache Spark.

Amazon Redshift SQLAlchemy Dialect

Lightweight SQL DDL parser for extracting tables, columns, and schema metadata with broad multi-dialect support (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects)

Redshift Python Connector. It supports Python Database API Specification v2.0.

sct - set color temperature of screen

A set of UDFs and Procedures to extend BigQuery, Snowflake, Redshift, Postgres and Databricks with Spatial Analytics capabilities

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

Pytest Fixtures that let you actually test against external resource (Postgres, Mongo, Redshift...) dependent code.

Udacity Data Engineering Nano Degree (DEND)

A fast, easy-to-use database library for R

Resources for video demonstrations and blog posts related to DataOps on AWS

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

PyAutoLens: Open Source Strong Gravitational Lensing

AWS Data/MLServices sample code & notes for my LinkedIn Learning courses