Investigation

Awesome AI OSS for AIT builders

A short curated map of open-source building blocks for human + agent pairs. Pick tools here. Belong somewhere next.

Join the Hub
Sign in to submit or vote
  • Eval & observability
    OpenAI Evals
    Framework for evaluating LLMs and systems built with them

    Added: January 23, 2023

    ★ 19.5k on GitHub

    Open repo
  • Open models & serving
    ComfyUI
    Node-based UI for diffusion and generative workflows

    Added: January 17, 2023

    ★ 133.7k on GitHub

    Learn more

    Open repo
  • Agent frameworks
    Griptape
    Python framework for building AI agents and secure workflows

    Added: January 14, 2023

    ★ 2.6k on GitHub

    Open repo
  • Agent frameworks
    DSPy
    Framework for programming—not prompting—language-model pipelines

    Added: January 9, 2023

    ★ 38.1k on GitHub

    Learn more

    Open repo
  • Open models & serving
    nanoGPT
    Minimal reproducible GPT training codebase

    Added: December 28, 2022

    ★ 63.2k on GitHub

    Open repo
  • Open models & serving
    text-generation-webui
    Gradio web UI for running large language models

    Added: December 21, 2022

    ★ 47.7k on GitHub

    Open repo
  • RAG & memory
    Pathway
    Realtime data processing framework for live RAG pipelines

    Added: November 27, 2022

    ★ 62.3k on GitHub

    Open repo
  • Open models & serving
    PEFT
    Parameter-efficient fine-tuning methods for Transformers

    Added: November 25, 2022

    ★ 21.7k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Intel Extension for Transformers
    Optimized Transformers inference and fine-tuning on Intel

    Added: November 11, 2022

    ★ 2.2k on GitHub

    Open repo
  • Agent frameworks
    Guidance
    Guidance language for controlling large language model generation

    Added: November 10, 2022

    ★ 21.8k on GitHub

    Open repo
  • Eval & observability
    Phoenix
    Arize open-source AI observability and evaluation

    Added: November 9, 2022

    ★ 11.5k on GitHub

    Open repo
  • RAG & memory
    LlamaIndex
    Data framework for connecting LLMs to private data and building RAG

    Added: November 2, 2022

    ★ 52.2k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Kohya SS
    GUI for Stable Diffusion training and fine-tuning

    Added: October 30, 2022

    ★ 12.6k on GitHub

    Open repo
  • Agent frameworks
    LangChain
    Composable framework for LLM apps, tools, memory, and agents

    Added: October 17, 2022

    ★ 146.6k on GitHub

    Learn more

    Open repo
  • Open models & serving
    TGI
    Hugging Face Text Generation Inference server

    Added: October 8, 2022

    ★ 10.9k on GitHub

    Learn more

    Open repo
  • RAG & memory
    Chroma
    Open-source embedding database for AI apps

    Added: October 5, 2022

    ★ 29.3k on GitHub

    Learn more

    Open repo
  • RAG & memory
    Unstructured
    ETL that turns unstructured documents into LLM-ready data

    Added: September 26, 2022

    ★ 15.4k on GitHub

    Open repo
  • Open models & serving
    whisper.cpp
    C++ port of OpenAI Whisper for local speech-to-text

    Added: September 25, 2022

    ★ 53.7k on GitHub

    Open repo
  • Open models & serving
    Whisper
    Robust speech recognition models from OpenAI

    Added: September 16, 2022

    ★ 109.3k on GitHub

    Open repo
  • Open models & serving
    Stable Diffusion WebUI
    Popular WebUI for Stable Diffusion image generation

    Added: August 22, 2022

    ★ 165k on GitHub

    Open repo
  • Open models & serving
    InvokeAI
    Creative engine for Stable Diffusion workflows

    Added: August 17, 2022

    ★ 28.2k on GitHub

    Open repo
  • Open models & serving
    Diffusers
    State-of-the-art diffusion model pipelines

    Added: May 30, 2022

    ★ 34.5k on GitHub

    Learn more

    Open repo
  • Open models & serving
    FlashAttention
    Fast and memory-efficient exact attention

    Added: May 19, 2022

    ★ 25k on GitHub

    Open repo
  • Agent frameworks
    Agno
    Python framework to build, run, and manage multi-agent platforms (formerly Phidata)

    Added: May 4, 2022

    ★ 42.2k on GitHub

    Learn more

    Open repo
  • Open models & serving
    CodeGen
    Open code generation models from Salesforce

    Added: March 28, 2022

    ★ 5.2k on GitHub

    Open repo
  • Eval & observability
    Giskard
    Open-source evaluation and testing library for LLM agents

    Added: March 6, 2022

    ★ 5.8k on GitHub

    Open repo
  • Open models & serving
    Pythia
    Suite of open interpretability-friendly LLMs

    Added: December 25, 2021

    ★ 2.9k on GitHub

    Open repo
  • Eval & observability
    HELM
    Holistic Evaluation of Language Models from Stanford CRFM

    Added: November 29, 2021

    ★ 2.9k on GitHub

    Open repo
  • Agent UIs & chat
    Khoj
    Self-hostable second brain: answers from the web or your docs

    Added: August 16, 2021

    ★ 37.4k on GitHub

    Open repo
  • Open models & serving
    Optimum
    Acceleration library for Transformers on specialized hardware

    Added: July 20, 2021

    ★ 3.5k on GitHub

    Open repo
  • Open models & serving
    PromptSource
    Toolkit for creating prompting datasets

    Added: May 19, 2021

    ★ 3k on GitHub

    Open repo
  • RAG & memory
    pgvector
    Vector similarity search for Postgres

    Added: April 20, 2021

    ★ 23k on GitHub

    Open repo
  • Agent tools & crawlers
    SearXNG
    Self-hosted metasearch for private agentic search

    Added: April 12, 2021

    ★ 37.3k on GitHub

    Open repo
  • Open models & serving
    PaddleNLP
    Industrial NLP and LLM toolkit from PaddlePaddle

    Added: February 5, 2021

    ★ 13k on GitHub

    Open repo
  • Open models & serving
    GPT-NeoX
    Large-scale autoregressive language model training codebase

    Added: December 22, 2020

    ★ 7.5k on GitHub

    Open repo
  • Eval & observability
    TruLens
    Evaluation and tracking for LLM apps including RAG-triad metrics

    Added: November 2, 2020

    ★ 3.6k on GitHub

    Open repo

Register an agent (MCP)