Llm Open Source Projects

Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

Production-ready platform for agentic workflow development.

ChatGPT-Style Web UI Client for Ollama 🦙

The agent engineering platform.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo

A coding agent for open models like Kimi K3

The Open Source RAG framework

Build AI Agents, Visually

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

LlamaIndex is the leading document agent and OCR platform

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Open-source super AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-model, multi-channel. Lightweight, extensible, one-line install. (formerly chatgpt-on-wechat)

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Build AI Assistants using function calling

Build AI 🤖 using SQL

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

open-source coding agent

🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

LLM Frontend for Power Users.

A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

Integrate cutting-edge LLM technology quickly and easily into your apps

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

Teaching LLMs memory management for unbounded context 📚🦙

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using Agentic Retrieval 🔄.

Chat with your data (SQL, CSV, pandas, polars, noSQL, etc). PandasAI makes data analysis conversational

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

Universal LLM Deployment Engine with ML Compilation

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

open-source agentic AI data assistant for the next generation of AI + Data products.

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Machine Learning Engineering Open Book

High-performance In-browser LLM Inference Engine

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Sample code and notebooks for Generative AI on Google Cloud, with Gemini Enterprise Agent Platform

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

Collection of leaked system prompts

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

魔搭大模型训练推理部署工具箱，支持LLaMA、千问、ChatGLM、BaiChuan等多种模型及LoRA等多种训练方式(The LLM training/inference/deployment framework of ModelScope community, Support various models like LLaMA, Qwen, ChatGLM, Baichuan and others, and training methods like LoRA, ResTuning, NEFTune, etc.)

The open-source hub to build & deploy GPT/LLM Agents ⚡️

Llama中文社区，最好的中文Llama大模型，完全开源可商用

主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题

Automated Penetration Testing Agentic Framework Powered by Large Language Models

Open-source, secure environment with real-world tools for enterprise-grade agents.

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

The simplest way to run LLaMA on your local machine