[J] JOIN
Investigation

Awesome AI OSS for AIT builders

A short curated map of open-source building blocks for human + agent pairs. Pick tools here. Belong somewhere next.

Join the Hub
Sign in to submit or vote
  • Open models & serving
    mistral-inference
    Reference inference for Mistral open models

    Added: September 27, 2023

    ★ 10.8k on GitHub

    Open repo
  • Agent frameworks
    TaskWeaver
    Code-first agent framework for data analytics tasks

    Added: September 11, 2023

    ★ 6.2k on GitHub

    Open repo
  • Open models & serving
    llamafile
    Distribute and run LLMs as a single-file executable

    Added: September 10, 2023

    ★ 26.5k on GitHub

    Open repo
  • Open models & serving
    ExLlamaV2
    Fast inference library for local LLMs on consumer GPUs

    Added: August 30, 2023

    ★ 4.6k on GitHub

    Open repo
  • Agent frameworks
    ChatDev
    Communicative multi-agent framework for collaborative software development

    Added: August 28, 2023

    ★ 34.6k on GitHub

    Open repo
  • Eval & observability
    Portkey Gateway
    Open-source AI gateway for routing, fallbacks, guardrails

    Added: August 23, 2023

    ★ 13.3k on GitHub

    Open repo
  • Agent frameworks
    AutoGen
    Multi-agent conversation framework from Microsoft Research

    Added: August 18, 2023

    ★ 61.7k on GitHub

    Open repo
  • RAG & memory
    cognee
    Open-source AI memory platform that builds knowledge graphs for agents

    Added: August 16, 2023

    ★ 33k on GitHub

    Open repo
  • Open models & serving
    TensorRT-LLM
    NVIDIA optimized LLM inference with TensorRT

    Added: August 16, 2023

    ★ 15k on GitHub

    Open repo
  • Agent tools & crawlers
    AgentOps
    Observability and testing toolkit for AI agents

    Added: August 15, 2023

    ★ 5.9k on GitHub

    Open repo
  • Eval & observability
    DeepEval
    LLM evaluation framework with RAG and agent metrics

    Added: August 10, 2023

    ★ 19.3k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Qwen
    Qwen large language model series

    Added: August 3, 2023

    ★ 22k on GitHub

    Open repo
  • RAG & memory
    FlagEmbedding
    BGE embedding and retrieval toolkit for RAG systems

    Added: August 2, 2023

    ★ 12.3k on GitHub

    Open repo
  • Eval & observability
    LiteLLM
    Unified SDK/proxy to call 100+ LLM APIs in OpenAI format

    Added: July 27, 2023

    ★ 62.6k on GitHub

    Learn more

    Open repo
  • Agent tools & crawlers
    LLM Guard
    Security toolkit for scanning and guarding LLM interactions

    Added: July 27, 2023

    ★ 3.2k on GitHub

    Open repo
  • RAG & memory
    FalkorDB
    Graph database optimized for GraphRAG workloads

    Added: July 20, 2023

    ★ 10.5k on GitHub

    Open repo
  • Open models & serving
    InternLM
    InternLM open bilingual foundation models

    Added: July 6, 2023

    ★ 7.3k on GitHub

    Open repo
  • Open models & serving
    ollama/ollama
    Local model run

    Added: July 1, 2023

    ★ 185.7k on GitHub

    Learn more

    Open repo
  • Agent frameworks
    MetaGPT
    Multi-agent framework that simulates a software company

    Added: June 30, 2023

    ★ 71.1k on GitHub

    Open repo
  • Open models & serving
    DOLMA
    Open dataset of 3T tokens for language model pretraining

    Added: June 20, 2023

    ★ 1.6k on GitHub

    Open repo
  • RAG & memory
    mem0
    Drop-in memory layer for AI agents and apps

    Added: June 20, 2023

    ★ 68.3k on GitHub

    Learn more

    Open repo
  • Open models & serving
    vllm-project/vllm
    Open model serving

    Added: June 20, 2023

    ★ 96.2k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Candle
    Minimalist ML framework for Rust

    Added: June 19, 2023

    ★ 21.3k on GitHub

    Open repo
  • Agent UIs & chat
    CopilotKit
    React UI primitives for in-app AI copilots

    Added: June 19, 2023

    ★ 38.5k on GitHub

    Open repo
  • Eval & observability
    OpenCompass
    LLM evaluation platform with many benchmarks

    Added: June 15, 2023

    ★ 7.6k on GitHub

    Open repo
  • Agent frameworks
    Instructor
    Structured LLM outputs via Pydantic validation

    Added: June 14, 2023

    ★ 14.1k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Open Instruct
    Code and data for open instruction tuning

    Added: June 9, 2023

    ★ 3.9k on GitHub

    Open repo
  • Agent UIs & chat
    AnythingLLM
    Self-hosted AI workspace with RAG, agents, and chat

    Added: June 4, 2023

    ★ 67.9k on GitHub

    Open repo
  • Agent UIs & chat
    Continue
    Open-source AI coding assistant for VS Code and JetBrains

    Added: May 24, 2023

    ★ 36.4k on GitHub

    Open repo
  • Agent frameworks
    Vercel AI SDK
    TypeScript toolkit for building AI apps and streaming UIs

    Added: May 23, 2023

    ★ 27.7k on GitHub

    Learn more

    Open repo
  • Eval & observability
    Langfuse
    Open-source tracing, prompt management, and evals

    Added: May 18, 2023

    ★ 36.9k on GitHub

    Learn more

    Open repo
  • Agent tools & crawlers
    GPT Researcher
    Autonomous agent that researches a topic and writes a sourced report

    Added: May 12, 2023

    ★ 30.4k on GitHub

    Open repo
  • RAG & memory
    Quivr
    Opinionated RAG platform for integrating GenAI into applications

    Added: May 12, 2023

    ★ 39.6k on GitHub

    Open repo
  • Agent frameworks
    Superagent
    Guardrails runtime for AI apps against prompt injection and data leaks

    Added: May 10, 2023

    ★ 6.8k on GitHub

    Open repo
  • Agent frameworks
    Aider
    AI pair programming in the terminal that edits local git repos

    Added: May 9, 2023

    ★ 49.9k on GitHub

    Open repo
  • Eval & observability
    Ragas
    Evaluation framework for RAG pipelines

    Added: May 8, 2023

    ★ 16.2k on GitHub

    Learn more

    Open repo