开源精选 · 开源大模型

最好的开源大模型

每日更新。60 个项目,按 star 排序,并核对 fork 与维护活跃度。

开源大模型 镇场榜

成熟且仍在更新的项目。GitHub 上标注了 large-language-models, local-llm。

  1. langflow-ai/langflow Python ★ 155,502 本周 +245

    Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

  2. rasbt/LLMs-from-scratch Jupyter Notebook ★ 106,010 本周 +373

    Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

  3. mlabonne/llm-course ★ 83,289 本周 +127 最近提交在半年前

    Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

  4. hiyouga/LlamaFactory Python ★ 75,311 本周 +209

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

  5. binary-husky/gpt_academic Python ★ 71,403 本周 +46 最近提交在半年前

    为GPT/GLM等LLM大语言模型提供实用化交互接口,特别优化论文阅读/润色/写作体验,模块化设计,支持自定义快捷按钮&函数插件,支持Python和C++等项目剖析&自译解功能,PDF/LaTex论文翻译&总结功能,支持并行问询多种LLM模型,支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

  6. bojieli/ai-agent-book Python ★ 52,352 本周 +985

    《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

  7. HKUDS/nanobot Python ★ 48,783 本周 +199

    Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps

  8. ray-project/ray Python ★ 43,970 本周 +48

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

  9. HKUDS/LightRAG Python ★ 39,979 本周 +115

    [EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

  10. google/langextract Python ★ 38,918 本周 +42

    A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

  11. langfuse/langfuse TypeScript ★ 35,380 本周 +269

    🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

  12. agentscope-ai/agentscope Python ★ 32,756 本周 +296

    Build and run agents you can see, understand and trust.

  13. aishwaryanr/awesome-generative-ai-guide HTML ★ 29,685 本周 +88

    A one stop repository for generative AI research updates, interview resources, notebooks and much more!

  14. HandsOnLLM/Hands-On-Large-Language-Models Jupyter Notebook ★ 29,440 本周 +142

    Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

  15. deepset-ai/haystack Python ★ 26,650 本周 +43

    Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

  16. mozilla-ai/llamafile C++ ★ 26,168 本周 +96

    Distribute and run LLMs with a single file.

  17. QwenLM/Qwen Python ★ 21,887 本周 +30 最近提交在半年前

    The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

  18. AI4Finance-Foundation/FinGPT Jupyter Notebook ★ 21,349 本周 +66

    FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

  19. stefan-jansen/machine-learning-for-trading Jupyter Notebook ★ 21,219 本周 +147

    Code for Machine Learning for Trading, 3rd edition - from data sourcing to live execution.

  20. stas00/ml-engineering Python ★ 19,096 本周 +49

    Machine Learning Engineering Open Book

  21. ymcui/Chinese-LLaMA-Alpaca Python ★ 18,936 本周 +1

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

  22. NVIDIA/Megatron-LM Python ★ 18,067 本周 +44

    Ongoing research training transformer models at scale

  23. :sparkles::sparkles:Latest Advances on Multimodal Large Language Models

  24. camel-ai/camel Python ★ 17,810 本周 +32

    🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org

  25. GoogleCloudPlatform/generative-ai Jupyter Notebook ★ 17,784 本周 +22

    Sample code and notebooks for Generative AI on Google Cloud, with Gemini Enterprise Agent Platform

  26. GreyDGL/PentestGPT Python ★ 15,718 本周 +114

    Automated Penetration Testing Agentic Framework Powered by Large Language Models

  27. Lightning-AI/litgpt Python ★ 13,693 本周 +9

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  28. neuml/txtai Python ★ 12,991 本周 +12

    💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

  29. steven2358/awesome-generative-ai ★ 12,709 本周 +23

    A curated list of modern Generative Artificial Intelligence projects and services

  30. Pocket Flow: Codebase to Tutorial

  31. sapientinc/HRM Python ★ 12,647 本周 +5 最近提交在半年前

    Hierarchical Reasoning Model Official Release

  32. OpenMOSS/MOSS Python ★ 12,264 本周 +3

    An open-source, tool-augmented conversational language model from Fudan University

  33. FareedKhan-dev/train-llm-from-scratch Python ★ 11,958 本周 +515

    A straightforward method for training your LLM, from downloading data to generating text.

  34. The-Pocket/PocketFlow Python ★ 11,221 本周 +26

    Pocket Flow: 100-line LLM framework. Let Agents build Agents!

  35. KalyanKS-NLP/llm-engineer-toolkit ★ 10,880 本周 +4

    A curated list of 120+ LLM libraries category wise.

  36. A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

  37. OpenRLHF/OpenRLHF Python ★ 10,067 本周 +24

    An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

  38. Tiiny-AI/PowerInfer C++ ★ 9,814 本周 +7

    High-speed Large Language Model Serving for Local Deployment

  39. yzhao062/anomaly-detection-resources Python ★ 9,406 本周 +9 最近提交在半年前

    Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!

  40. LearningCircuit/local-deep-research Python ★ 9,152 本周 +22

    ~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

开源大模型 新秀榜

近 90 天新建、涨势最猛的项目。

  1. syv-ai/HyperQwen Python ★ 1,856 本周 +125

    Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

  2. TokenRhythm/NeoHorse Python ★ 1,602 本周 +444

    NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness.

  3. youngyangyang04/llm-master ★ 1,077 本周 +86

    大模型(LLM)全栈学习路线与中文教程🔥:覆盖 Prompt Engineering、RAG、AI Agent、MCP、微调、模型部署、Transformer、AI 编程与大厂面试,从入门到生产实践。

  4. peonist-ai/halogen-flash-server Shell ★ 833 本周 +103

    The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

  5. gavamedia/deltafin Rust ★ 828 本周 +3

    Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

  6. whitecircle/halo Python ★ 815 本周 +60

    Halo is an open-source framework built by White Circle for training large language and multimodal models

  7. leonickson1/Swiftlet Swift ★ 652 本周 +2

    Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

  8. Nehanth/pooled JavaScript ★ 568 本周 +107

    Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

  9. xinxuxin/keystone-bench Python ★ 526 本周 +117

    A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.

  10. amitshekhariitbhu/ai-engineering-course Markdown ★ 499 本周 +89

    AI Engineering Course - A free and complete AI Engineering Course to learn AI Engineering step by step - from Machine Learning, Neural Networks, and Transformers to LLMs, Fine-Tuning, RAG, AI Agents, LLM Inference, Evaluation, AI Safety, and AI System Design.

  11. carloslfu/slotstream Swift ★ 413 本周 +12

    Run a 105 GB AI model on a Mac that can't hold it. Slotstream streams Qwen3.8-Flash-Next (125B mixture of experts) from your SSD and caches the busiest experts in memory, so it runs on Macs with 16 to 64 GB. One native Swift binary on MLX and Metal, no Python, offline. Works with Claude Code, Codex and Ollama or OpenAI clients.

  12. StayLameBro/backburner Python ★ 400 本周 +400

    Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

  13. Yzw202011/OmniSpace Python ★ 353 本周 +104 star 涨幅快过 fork

    本地优先的全栈 AI 创作工作站:AI对话 · AI漫画 · 漫剧创作 · 写作台 · 知识学习五大模块;vLLM / llama.cpp / Transformers 多引擎本地推理,显存智能调度、舱壁隔离自愈、仅供学习使用,欢迎交流指正。(最新进度(除插件系统)受到协议限制,暂时无法提交到仓库)

  14. CyberSunil/LLMVault Python ★ 332 本周 +3

    An intentionally vulnerable OWASP LLM Top 10 training platform for AI Security, Prompt Injection, RAG Security, Agent Security, and GenAI penetration testing.

  15. amitshekhariitbhu/llm-inference-engineering Markdown ★ 294 本周 +12

    Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

  16. ThinkOffApp/CarWatch Python ★ 294 本周 +2

    Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.

  17. Wassimyounes01/qwen38-uncensored JavaScript ★ 292 本周 +126

    Local Qwen 3.8 27B uncensored Q4_K_M + harvested SYSTEM pack. Official 3.8 weights, not a 3.6 retitle.

  18. TaoLiveAIGC/TLive-Omni Python ★ 291 本周 +117 star 涨幅快过 fork

    TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming

  19. rokbenko/quackd Python ★ 248 本周 +8

    One CLI for all your robots. Connect them, command them, and let them work together, each with an LLM for a brain (Claude, OpenAI, Gemini, Grok, or local via Ollama or vLLM), VLAs for arms and decision LLMs (Jev, Laya, Kev). Drives Microduck, Open Duck Mini, LeRobot, XLeRobot, AlohaMini, ToddlerBot, or any ROS 2 base from a laptop, offboard.

  20. Extraltodeus/J-Wash Python ★ 230 本周 +1

    Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian Lens. Results are exportable.

这份榜单怎么来的

候选来自 GitHub 话题标签 large-language-models, local-llm。star 数与周增长取自 GitHub 官方的 star 历史接口,因此数字与 GitHub 自己的口径一致。榜单收录活跃、话题数量至多 20 个的仓库。某个项目的 star 数相对 fork 数明显偏高时会被标注,可结合仓库活动进一步了解原因。