Lora Open Source Projects

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

stable diffusion webui colab

魔搭大模型训练推理部署工具箱，支持LLaMA、千问、ChatGLM、BaiChuan等多种模型及LoRA等多种训练方式(The LLM training/inference/deployment framework of ModelScope community, Support various models like LLaMA, Qwen, ChatGLM, Baichuan and others, and training methods like LoRA, ResTuning, NEFTune, etc.)

Llama中文社区，最好的中文Llama大模型，完全开源可商用

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

The official firmware for Meshtastic, an open-source, off-grid mesh communication system.

Using Low-rank adaptation to quickly fine-tune diffusion models.

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.

SD-Trainer. LoRA & Dreambooth training scripts & GUI use kohya-ss's trainer, for diffusion model.

High Performance Open Source Radio Control Link

MQTT gateway for ESP8266 or ESP32 with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermometer compatibility & LoRa.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

基于ChatGLM-6B + LoRA的Fintune方案

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

STM32 core support for Arduino

OneTrainer is a one-stop solution for all your Diffusion training needs.

LLM Finetuning with peft

A Unified Library for Parameter-Efficient and Modular Transfer Learning

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型，由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)

Universal wireless communication library for embedded devices

Communicate Freely

Wifi & BLE driven passenger flow metering with cheap ESP32 boards

ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利

Reference implementation and documentation of a LoRa network node.

OneDiff: An out-of-the-box acceleration library for diffusion models.

An Arduino library for sending and receiving data using LoRa radios.

Android application for Meshtastic

LXMF client for Android, Linux and macOS allowing you to communicate with people or LXMF-compatible systems over Reticulum networks using LoRa, Packet Radio, WiFi, I2P, or anything else Reticulum supports.

chatglm 6b finetuning and alpaca finetuning

ChirpStack Network Server is an open-source LoRaWAN network-server.

An Open-sourced Knowledgable Large Language Model Framework.

Lua RTOS for ESP32

Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment

Serving multiple LoRA finetuned LLM as one

The Things Stack, an Open Source LoRaWAN Network Server

A (paused) work-in-progress long-range, low-bandwidth wireless disaster recovery mesh network powered by the sun.

《AI 研发提效：自己动手训练 LoRA》，包含 Llama （Alpaca LoRA）模型、ChatGLM （ChatGLM Tuning）相关 Lora 的训练。训练内容：用户故事生成、测试代码生成、代码辅助生成、文本转 SQL、文本生成代码……

ChirpStack open-source LoRaWAN Network Server

Compact server for private LoRaWAN networks

:airplane: Multi-functional, compatible DIY general aviation proximity awareness system

This is the fully-functional GNU Radio software-defined radio (SDR) implementation of a LoRa transceiver with all the necessary receiver components to operate correctly even at very low SNRs. This work has been conducted at the Telecommunication Circuits Laboratory, EPFL.

Arduino source codes and toolchain for WiFi_Kit_series made by HelTecAutomation.

CatSniffer is an original multiprotocol and multiband board for sniffing, communicating, and attacking IoT (Internet of Things) devices using the latest radio IoT protocols. It is a highly portable USB stick that integrates TI CC1352, Semtech SX1262, and an RP2040 for V3 or a Microchip SAMD21E17 for V2

Arduino library for Heltec ESP32 (or ESP32+LoRa) based boards

Repository that contains LLM fine-tuning and deployment scripts along with our research findings.

🌟 ChatGenTitle：使用百万arXiv论文信息在LLaMA模型上进行微调的论文题目生成模型

A microframework on top of PyTorch with first-class citizen APIs for foundation model adaptation

The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥

🛋 The AI and Generative Art platform for everyone

AI 图片生成

A LoRa packet forwarder is a program running on the host of a LoRa gateway that forwards RF packets receive by the concentrator to a server through a IP/UDP link, and emits RF packets that are sent by the server. This project is associated to the lora_gateway repository for SX1301 chip. For SX1302/1303, the repository sx1302_hal must be used.

Low-cost LoRa IoT & gateway with SX12XX (SX1261/62/68; SX1272/76/77/78/79; SX1280/81), RaspberryPI and Arduino boards