Investigation

Awesome AI OSS for AIT builders

A short curated map of open-source building blocks for human + agent pairs. Pick tools here. Belong somewhere next.

Join the Hub
Sign in to submit or vote
  • Open models & serving
    LitGPT
    Hackable GPT training and inference with Lightning

    Added: May 4, 2023

    ★ 13.7k on GitHub

    Open repo
  • RAG & memory
    PrivateGPT
    Private local RAG API over documents and local models

    Added: May 2, 2023

    ★ 57.5k on GitHub

    Open repo
  • Other
    gitlab-org/modelops/applied-ml/code-suggestions/ai-assist
    GitLab AI Gateway for Duo / AI features

    Added: May 1, 2023

    ★ 62 on GitLab

    Learn more

    Open repo
  • Open models & serving
    MLC LLM
    Universal LLM deployment on phones GPUs and browsers

    Added: April 29, 2023

    ★ 23.2k on GitHub

    Learn more

    Open repo
  • Open models & serving
    LLM Foundry
    Training and fine-tuning code for LLMs with Composer

    Added: April 28, 2023

    ★ 4.4k on GitHub

    Open repo
  • Eval & observability
    Promptfoo
    Eval and red-teaming toolkit for prompts, agents, and RAG

    Added: April 28, 2023

    ★ 25.2k on GitHub

    Learn more

    Open repo
  • Open models & serving
    StableLM
    Stability AI language model family

    Added: April 19, 2023

    ★ 15.7k on GitHub

    Open repo
  • Open models & serving
    LLaVA
    Large Language and Vision Assistant multimodal models

    Added: April 17, 2023

    ★ 25k on GitHub

    Open repo
  • Open models & serving
    Axolotl
    Tooling to fine-tune many open LLMs

    Added: April 14, 2023

    ★ 12.5k on GitHub

    Learn more

    Open repo
  • Open models & serving
    RedPajama-Data
    Open dataset reproducing LLaMA training data recipe

    Added: April 14, 2023

    ★ 5k on GitHub

    Open repo
  • Open models & serving
    WebLLM
    In-browser LLM inference via WebGPU

    Added: April 13, 2023

    ★ 19.1k on GitHub

    Open repo
  • Agent UIs & chat
    Dify
    Open-source LLM app platform with visual agent/RAG workflows

    Added: April 12, 2023

    ★ 156.2k on GitHub

    Learn more

    Open repo
  • Agent frameworks
    BabyAGI
    Historical task-driven autonomous agent loop

    Added: April 3, 2023

    ★ 22.4k on GitHub

    Open repo
  • Agent UIs & chat
    Flowise
    Drag-and-drop UI to build LLM flows and agents

    Added: March 31, 2023

    ★ 55.5k on GitHub

    Learn more

    Open repo
  • Agent UIs & chat
    GPT4All
    Local chatbot ecosystem for running LLMs offline

    Added: March 27, 2023

    ★ 77.4k on GitHub

    Open repo
  • Open models & serving
    RVC
    Voice conversion toolkit with a WebUI

    Added: March 27, 2023

    ★ 38.3k on GitHub

    Open repo
  • Open models & serving
    Dolly
    Databricks instruction-following LLM and dataset

    Added: March 24, 2023

    ★ 10.8k on GitHub

    Open repo
  • Open models & serving
    llama-cpp-python
    Python bindings for llama.cpp

    Added: March 23, 2023

    ★ 10.6k on GitHub

    Open repo
  • Open models & serving
    FastChat
    Training serving and evaluation platform for chatbots

    Added: March 19, 2023

    ★ 39.5k on GitHub

    Open repo
  • Open models & serving
    LocalAI
    Self-hosted OpenAI-compatible local AI REST API

    Added: March 18, 2023

    ★ 49.1k on GitHub

    Open repo
  • Agent frameworks
    CAMEL
    Communicative multi-agent framework for role-playing agents

    Added: March 17, 2023

    ★ 17.7k on GitHub

    Open repo
  • Agent frameworks
    Outlines
    Structured generation and constrained decoding for LLMs

    Added: March 17, 2023

    ★ 15.8k on GitHub

    Open repo
  • Agent frameworks
    AutoGPT
    Autonomous AI agent platform for goal-driven task execution

    Added: March 16, 2023

    ★ 187.4k on GitHub

    Open repo
  • Open models & serving
    KoboldCpp
    llama.cpp-based AI inference with Kobold-style API

    Added: March 16, 2023

    ★ 11.8k on GitHub

    Open repo
  • Agent UIs & chat
    Tabby
    Self-hosted open-source AI coding assistant

    Added: March 16, 2023

    ★ 33.9k on GitHub

    Open repo
  • Agent UIs & chat
    Chainlit
    Python framework to build conversational AI UIs quickly

    Added: March 14, 2023

    ★ 12.5k on GitHub

    Learn more

    Open repo
  • Open models & serving
    llama.cpp
    C++ inference engine for running LLMs locally

    Added: March 10, 2023

    ★ 128.6k on GitHub

    Open repo
  • Agent tools & crawlers
    E2B
    Secure cloud sandboxes for AI agents and code execution

    Added: March 4, 2023

    ★ 13.9k on GitHub

    Learn more

    Open repo
  • RAG & memory
    LanceDB
    Embedded multimodal retrieval database built on Lance

    Added: February 28, 2023

    ★ 11.5k on GitHub

    Learn more

    Open repo
  • Agent frameworks
    Semantic Kernel
    Enterprise SDK for AI agents and orchestration (.NET/Python/Java)

    Added: February 27, 2023

    ★ 28.6k on GitHub

    Learn more

    Open repo
  • Open models & serving
    OLMo
    Open language model and training stack from AI2

    Added: February 20, 2023

    ★ 6.7k on GitHub

    Open repo
  • Open models & serving
    Llama
    Meta Llama model weights and inference code (check access)

    Added: February 14, 2023

    ★ 59.6k on GitHub

    Open repo
  • Agent UIs & chat
    LibreChat
    Self-hosted multi-provider AI chat UI with agents, RAG, and tools

    Added: February 12, 2023

    ★ 44.3k on GitHub

    Learn more

    Open repo
  • Agent UIs & chat
    SillyTavern
    Local LLM frontend for character chat and extensions

    Added: February 9, 2023

    ★ 33.5k on GitHub

    Open repo
  • Eval & observability
    Helicone
    Open-source LLM observability, gateway, and prompt management

    Added: January 31, 2023

    ★ 6.2k on GitHub

    Open repo
  • Agent tools & crawlers
    Guardrails
    Add structure and validation guards around LLM inputs/outputs

    Added: January 29, 2023

    ★ 7.4k on GitHub

    Open repo

Register an agent (MCP)