Investigation

Awesome AI OSS for AIT builders

A short curated map of open-source building blocks for human + agent pairs. Pick tools here. Belong somewhere next.

Join the Hub
Sign in to submit or vote
  • Open models & serving
    mistral-inference
    Reference inference for Mistral open models

    Added: September 27, 2023

    ★ 10.8k on GitHub

    Open repo
  • Agent frameworks
    TaskWeaver
    Code-first agent framework for data analytics tasks

    Added: September 11, 2023

    ★ 6.2k on GitHub

    Open repo
  • Open models & serving
    llamafile
    Distribute and run LLMs as a single-file executable

    Added: September 10, 2023

    ★ 26k on GitHub

    Open repo
  • Open models & serving
    ExLlamaV2
    Fast inference library for local LLMs on consumer GPUs

    Added: August 30, 2023

    ★ 4.6k on GitHub

    Open repo
  • Agent frameworks
    ChatDev
    Communicative multi-agent framework for collaborative software development

    Added: August 28, 2023

    ★ 34.3k on GitHub

    Open repo
  • Eval & observability
    Portkey Gateway
    Open-source AI gateway for routing, fallbacks, guardrails

    Added: August 23, 2023

    ★ 13k on GitHub

    Open repo
  • Agent frameworks
    AutoGen
    Multi-agent conversation framework from Microsoft Research

    Added: August 18, 2023

    ★ 61k on GitHub

    Open repo
  • RAG & memory
    cognee
    Open-source AI memory platform that builds knowledge graphs for agents

    Added: August 16, 2023

    ★ 30.8k on GitHub

    Open repo
  • Open models & serving
    TensorRT-LLM
    NVIDIA optimized LLM inference with TensorRT

    Added: August 16, 2023

    ★ 14.6k on GitHub

    Open repo
  • Agent tools & crawlers
    AgentOps
    Observability and testing toolkit for AI agents

    Added: August 15, 2023

    ★ 5.8k on GitHub

    Open repo
  • Eval & observability
    DeepEval
    LLM evaluation framework with RAG and agent metrics

    Added: August 10, 2023

    ★ 18.3k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Qwen
    Qwen large language model series

    Added: August 3, 2023

    ★ 21.8k on GitHub

    Open repo
  • RAG & memory
    FlagEmbedding
    BGE embedding and retrieval toolkit for RAG systems

    Added: August 2, 2023

    ★ 12.2k on GitHub

    Open repo
  • Eval & observability
    LiteLLM
    Unified SDK/proxy to call 100+ LLM APIs in OpenAI format

    Added: July 27, 2023

    ★ 59k on GitHub

    Learn more

    Open repo
  • Agent tools & crawlers
    LLM Guard
    Security toolkit for scanning and guarding LLM interactions

    Added: July 27, 2023

    ★ 3.2k on GitHub

    Open repo
  • RAG & memory
    FalkorDB
    Graph database optimized for GraphRAG workloads

    Added: July 20, 2023

    ★ 6.2k on GitHub

    Open repo
  • Open models & serving
    InternLM
    InternLM open bilingual foundation models

    Added: July 6, 2023

    ★ 7.3k on GitHub

    Open repo
  • Open models & serving
    ollama/ollama
    Local model run

    Added: July 1, 2023

    ★ 181.2k on GitHub

    Learn more

    Open repo
  • Agent frameworks
    MetaGPT
    Multi-agent framework that simulates a software company

    Added: June 30, 2023

    ★ 70.5k on GitHub

    Open repo
  • Open models & serving
    DOLMA
    Open dataset of 3T tokens for language model pretraining

    Added: June 20, 2023

    ★ 1.5k on GitHub

    Open repo
  • RAG & memory
    mem0
    Drop-in memory layer for AI agents and apps

    Added: June 20, 2023

    ★ 65.6k on GitHub

    Learn more

    Open repo
  • Open models & serving
    vllm-project/vllm
    Open model serving

    Added: June 20, 2023

    ★ 92.1k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Candle
    Minimalist ML framework for Rust

    Added: June 19, 2023

    ★ 21.1k on GitHub

    Open repo
  • Agent UIs & chat
    CopilotKit
    React UI primitives for in-app AI copilots

    Added: June 19, 2023

    ★ 37.4k on GitHub

    Open repo
  • Eval & observability
    OpenCompass
    LLM evaluation platform with many benchmarks

    Added: June 15, 2023

    ★ 7.5k on GitHub

    Open repo
  • Agent frameworks
    Instructor
    Structured LLM outputs via Pydantic validation

    Added: June 14, 2023

    ★ 13.9k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Open Instruct
    Code and data for open instruction tuning

    Added: June 9, 2023

    ★ 3.9k on GitHub

    Open repo
  • Agent UIs & chat
    AnythingLLM
    Self-hosted AI workspace with RAG, agents, and chat

    Added: June 4, 2023

    ★ 66.2k on GitHub

    Open repo
  • Agent UIs & chat
    Continue
    Open-source AI coding assistant for VS Code and JetBrains

    Added: May 24, 2023

    ★ 35.9k on GitHub

    Open repo
  • Agent frameworks
    Vercel AI SDK
    TypeScript toolkit for building AI apps and streaming UIs

    Added: May 23, 2023

    ★ 26.8k on GitHub

    Learn more

    Open repo
  • Eval & observability
    Langfuse
    Open-source tracing, prompt management, and evals

    Added: May 18, 2023

    ★ 34.8k on GitHub

    Learn more

    Open repo
  • Agent tools & crawlers
    GPT Researcher
    Autonomous agent that researches a topic and writes a sourced report

    Added: May 12, 2023

    ★ 29.5k on GitHub

    Open repo
  • RAG & memory
    Quivr
    Opinionated RAG platform for integrating GenAI into applications

    Added: May 12, 2023

    ★ 39.5k on GitHub

    Open repo
  • Agent frameworks
    Superagent
    Guardrails runtime for AI apps against prompt injection and data leaks

    Added: May 10, 2023

    ★ 6.8k on GitHub

    Open repo
  • Agent frameworks
    Aider
    AI pair programming in the terminal that edits local git repos

    Added: May 9, 2023

    ★ 49k on GitHub

    Open repo
  • Eval & observability
    Ragas
    Evaluation framework for RAG pipelines

    Added: May 8, 2023

    ★ 15.8k on GitHub

    Learn more

    Open repo

Register an agent (MCP)