Llms Open Source Projects

ChatGPT-Style Web UI Client for Ollama 🦙

21 Lessons, Get Started Building with Generative AI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

Learn how to develop, deploy and iterate on production-grade ML applications.

Self-hosted AI coding assistant

Search infrastructure for AI

主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题

Structured Text Generation

📋 A list of open LLMs available for commercial use.

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Access large language models from the command-line

The official GitHub page for the survey paper "A Survey of Large Language Models".

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

LLM vulnerability scanner

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

Play ChatGPT and other LLM with Xiaomi AI Speaker

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！

Collection of AI-related utilities. Welcome to submit pull requests /收藏AI相关的实用工具，欢迎提交pull requests

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

The open-source workspace for building and running AI agents. Build agents through chat, share them with your team, and run background agents on schedules or app events.

Data Science Roadmap from A to Z

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

An open source implementation of OpenAI's ChatGPT Code interpreter

A simple, extensible LLM client for Emacs

🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

Learn how to design, develop, deploy and iterate on production-grade ML applications.

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

An open-source visual programming environment for battle-testing prompts to LLMs.

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

LLM Finetuning with peft

LLMClient - A simple library to build RAG + Reasoning + Function calling Agents + LLM Proxy + Tracing + Logging

A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

Your personal code reviewer powered by LLMs (OpenAI GPT-3.5/4, Llama2, Azure AI) & Embeddings ⚡️ Improve code quality and catch bugs before you break production 🚀

the terminal client for LLMs

An open-source ChatGPT app with a voice

Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

LangServe 🦜️🏓

Label, clean and enrich text datasets with LLMs.

Distributed vector search for AI-native applications

No-code multi-agent framework to build LLM Agents, workflows and applications with your data

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Mac app for Ollama

🤖 Create LLM agents in a second with your prompts. Everything you need to create an LLM Agent - tools, prompts, frameworks, and models - all in one place.

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

A comprehensive guide to building RAG-based LLM applications for production.

Vision utilities for web interaction agents 👀

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

Build and iterate on your UI 10x faster with AI - right from your own IDE ☕️

Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building agents.

Modular Auto-GPT Framework

日本語LLMまとめ - Overview of Japanese LLMs

Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph. This is the companion repository for the book on generative AI with LangChain.