Bert Open Source Projects

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

Natural Language Processing Tutorial for Deep Learning Researchers

Unified framework for building enterprise RAG pipelines with small, specialized models

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

This repository contains demos I made with the Transformers library by HuggingFace.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

vits2 backbone with multilingual-bert

BertViz: Visualize Attention in Transformer Models

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.

Google AI 2018 BERT pytorch implementation

Transformer related optimization, including BERT, GPT

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

Must-read papers on prompt-based tuning for pre-trained language models.

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Minimal keyword extraction with BERT

State of the Art Natural Language Processing

该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

中文nlp解决方案(大模型、数据、模型、训练、推理)

🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.

深度学习入门课、资深课、特色课、学术案例、产业实践案例、深度学习知识百科及面试题库The course, case and knowledge of Deep Learning and AI

快速上手AI理论及应用实战：基础知识、Transformer、NLP、ML、DL、竞赛。含大量注释及数据集，力求每一位能看懂并复现。

we want to create a repo to illustrate usage of transformers in chinese

LightSeq: A High Performance Library for Sequence Processing and Generation

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Top2Vec learns jointly embedded topic, document and word vectors.

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

A Unified Library for Parameter-Efficient and Modular Transfer Learning

RoBERTa中文预训练模型: RoBERTa for Chinese

该仓库主要记录 NLP 算法工程师相关的面试题

Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BER

Datasets, tools, and benchmarks for representation learning of code.

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

A curated list of pretrained sentence and word embedding models

Multi-Task Deep Neural Networks for Natural Language Understanding

The implementation of DeBERTa

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

Super easy library for BERT based NLP models

Transformers 库快速入门教程

Self-contained Machine Learning and Natural Language Processing library in Go

bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目

中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard