Diffusion Open Source Projects

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

An easy 1-click way to create beautiful artwork on your PC using AI, with no tech knowledge. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image.

Using Low-rank adaptation to quickly fine-tune diffusion models.

OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

Your Friendly Open-Source Gen-AI Platform

Stable diffusion for real-time music generation

🪩 Create Disco Diffusion artworks in one line

[SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

Kandinsky 2 — multilingual text2image latent diffusion model

Stable diffusion for real-time music generation (web app)

[CSUR] A Survey on Video Diffusion Models

collection of diffusion model papers categorized by their subareas

Fast stable diffusion on CPU and AI PC

Diffusion Models in Medical Imaging (Published in Medical Image Analysis Journal)

Efficient Retrieval Augmentation and Generation Framework

An extensible, easy-to-use, and portable diffusion web UI 👨‍🎨

A compendium of informations regarding Stable Diffusion (SD)

PALLAIDIUM — a generative AI movie studio, seamlessly integrated into the Blender Video Editor (VSE), enabling end-to-end production from script to screen and back.

Inpaint Anything extension performs stable diffusion inpainting on a browser UI using masks from Segment Anything.

A family of diffusion models for text-to-audio generation.

Self-contained, minimalistic implementation of diffusion models with Pytorch.

Wunjo CE: Face Swap, Lip Sync, Control Remove Objects & Text & Background, Restyling, Audio Separator, Clone Voice, Video Generation. Open Source, Local & Free.

Stable Diffusion in NCNN with c++, supported txt2img and img2img

List of Molecular and Material design using Generative AI and Deep Learning

Curated list of awesome resources for the Stable Diffusion AI Model.

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Diffusion attentive attribution maps for interpreting Stable Diffusion.

An easy to understand TTS / SVS / SVC framework

Run the official Stable Diffusion releases in a Docker container with txt2img, img2img, depth2img, pix2pix, upscale4x, and inpaint.

[NeurIPS 2022] Denoising Diffusion Restoration Models -- Official Code Repository

基于Stable Diffusion优化的AI绘画模型。支持输入中英文文本，可生成多种现代艺术风格的高质量图像。| An optimized text-to-image model based on Stable Diffusion. Both Chinese and English text inputs are available to generate images. The model can generate high-quality images in several modern art styles.

Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.

Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]

Yet another PyTorch implementation of Stable Diffusion (probably easy to read)

Official implementation for "Blended Diffusion for Text-driven Editing of Natural Images" [CVPR 2022]

A prompt generation helper script for AUTOMATIC1111/stable-diffusion-webui and compatible forks

Diffusion models of protein structure; trigonometry and attention are all you need!

[AAAI2024] FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning

Diffusion Classifier leverages pretrained diffusion models to perform zero-shot classification without additional training

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models (ICCV 2021 Oral)

A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.

The repo for studying and sharing diffusion models.

[ICLR 2024] Code for FreeNoise based on VideoCrafter

Official implementation of CVPR23 paper "Diffusion-based Generation, Optimization, and Planning in 3D Scenes"

The official PyTorch code for RoHM: Robust Human Motion Reconstruction via Diffusion.

Create butter-smooth transitions between prompts, powered by stable diffusion

Open reproduction of MUSE for fast text2image generation.

Pytorch implementation of diffusion models on Lie Groups for 6D grasp pose generation https://sites.google.com/view/se3dif/home

PyTorch Implementation of DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs

Colab notebook for Stable Diffusion Hyper-SDXL.

Low-rank adaptation for Erasing COncepts from diffusion models.

RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models - Official Repo

The official implementation for ICLR23 spotlight paper "DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion"

Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".

[CVPR 2023] DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Models

[ICCV 2023] Official PyTorch implementation of the paper "InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion"

[CVPR 2024] | LAMP: Learn a Motion Pattern for Few-Shot Based Video Generation