Trending AI reposUpdated daily from GitHub

High-speed Large Language Model Serving for Local Deployment

Cybersecurity AI (CAI), the framework for AI Security

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

智能闲鱼客服机器人系统：专为闲鱼平台打造的AI值守解决方案，实现闲鱼平台7×24小时自动化值守，支持多专家协同决策、智能议价和上下文感知对话。

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

😎 Awesome list of tools and projects with the awesome LangChain framework

The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent

The programming language for agents

Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

Running large language models on a single GPU for throughput-oriented scenarios.

Curated prompts, frameworks and papers for LLMs and agents, with an engineering bias. Prompt engineering, context engineering, agent harnesses, red teaming.

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

⚙️🦀 Build modular and scalable LLM Applications in Rust

🧑‍🚀 全世界最好的LLM资料总结（多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

vits2 backbone with multilingual-bert

TypeChat is a library that makes it easy to build natural language interfaces using types.

Accessible large language models via k-bit quantization for PyTorch.

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

An on-device AI agent for Android that operates apps and the web to get things done for you.

⚡ TabPFN: Foundation Model for Tabular Data ⚡

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

A collection of libraries to optimise AI model performances

Giving Kubernetes Superpowers to everyone

The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

Open-source Grok Bot alternative. Choose your own model and sandbox.

🦄🦄🦄AI赋能股票分析：AI加持的股票分析/选股工具。股票行情获取，AI热点资讯分析，AI资金/财务分析，涨跌报警推送。支持A股，港股，美股。支持市场整体/个股情绪分析，AI辅助选股等。数据全部保留在本地。支持DeepSeek，OpenAI， Ollama，LMStudio，AnythingLLM，硅基流动，火山方舟，阿里云百炼等平台或模型。

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Memory library for building stateful agents

Building a quick conversation-based search demo with Lepton AI.

Fast, flexible LLM inference

A series of large language models trained from scratch by developers @01-ai

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

dsh-purge Community · DeepSeek Harness 社区维护版：宿主兼容、状态诊断、提示词管理、更新与本机备份回滚。基于小杨 / YuJunZhiXue 的 dsh-purge。

Infrastructure for continually self‑improving agents

The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.

TSP自托管、零运维的 A 股「自建策略 + 监控 + 回测」量化工作台 | LLM能力驱使策略定制+个股分析+复盘 | 自由接入第三方数据源与个性化扩展数据 | 个人开源

AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models

Adding guardrails to large language models.

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

每个人都能看懂的大模型知识分享，LLMs春/秋招大模型面试前必看，让你和面试官侃侃而谈

《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

Tools for merging pretrained large language models.

The AI local media metadata crawler

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.