Investigation

Awesome AI OSS for AIT builders

A short curated map of open-source building blocks for human + agent pairs. Pick tools here. Belong somewhere next.

Join the Hub
Sign in to submit or vote
  • Open models & serving
    Accelerate
    Training and inference helpers for multi-GPU and TPU

    Added: October 30, 2020

    ★ 9.9k on GitHub

    Learn more

    Open repo
  • Open models & serving
    tinygrad
    Simple neural network framework aiming for ease of use

    Added: October 18, 2020

    ★ 33.6k on GitHub

    Open repo
  • Eval & observability
    lm-evaluation-harness
    Standardized few-shot evaluation harness for language models

    Added: August 28, 2020

    ★ 14k on GitHub

    Open repo
  • RAG & memory
    txtai
    All-in-one embeddings, semantic search, and RAG workflow framework

    Added: August 9, 2020

    ★ 13k on GitHub

    Open repo
  • RAG & memory
    Qdrant
    Open-source vector database and similarity search engine

    Added: May 30, 2020

    ★ 34.7k on GitHub

    Learn more

    Open repo
  • RAG & memory
    ColBERT
    Late-interaction retrieval toolkit for high-quality RAG

    Added: May 25, 2020

    ★ 3.9k on GitHub

    Open repo
  • Open models & serving
    Coqui TTS
    Deep learning toolkit for Text-to-Speech

    Added: May 20, 2020

    ★ 46k on GitHub

    Open repo
  • Open models & serving
    TRL
    Transformer Reinforcement Learning library for alignment

    Added: March 27, 2020

    ★ 19.3k on GitHub

    Learn more

    Open repo
  • Open models & serving
    DeepSpeed
    Deep learning optimization library for training at scale

    Added: January 23, 2020

    ★ 43.1k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Flax
    Neural network library for JAX

    Added: January 10, 2020

    ★ 7.3k on GitHub

    Open repo
  • RAG & memory
    Haystack
    Open-source orchestration framework for production RAG and LLM applications

    Added: November 14, 2019

    ★ 26.5k on GitHub

    Learn more

    Open repo
  • Open models & serving
    Tokenizers
    Fast Rust-backed tokenizers used across HF models

    Added: November 1, 2019

    ★ 11k on GitHub

    Open repo
  • RAG & memory
    Milvus
    Cloud-native open-source vector database for ANN search

    Added: September 16, 2019

    ★ 46.2k on GitHub

    Open repo
  • Open models & serving
    NeMo
    NVIDIA toolkit for conversational AI and LLM training

    Added: August 5, 2019

    ★ 18.5k on GitHub

    Open repo
  • RAG & memory
    sentence-transformers
    Embeddings, retrieval, and reranking for semantic search and RAG

    Added: July 24, 2019

    ★ 19.1k on GitHub

    Open repo
  • Agent frameworks
    n8n
    Fair-code workflow automation platform with AI agent nodes

    Added: June 22, 2019

    ★ 205.1k on GitHub

    Learn more

    Open repo
  • Agent tools & crawlers
    Trafilatura
    Web scraping library focused on main-text extraction for LLMs

    Added: April 8, 2019

    ★ 6.8k on GitHub

    Open repo
  • Open models & serving
    ONNX Runtime
    Cross-platform inference and training accelerator

    Added: November 10, 2018

    ★ 21.9k on GitHub

    Learn more

    Open repo
  • Open models & serving
    huggingface/transformers
    Models & tooling

    Added: November 8, 2018

    ★ 166.3k on GitHub

    Learn more

    Open repo
  • Open models & serving
    JAX
    Composable transformations of Python+NumPy programs

    Added: October 25, 2018

    ★ 36.3k on GitHub

    Learn more

    Open repo
  • Open models & serving
    OpenVINO
    Toolkit for optimizing and deploying AI inference

    Added: October 15, 2018

    ★ 10.9k on GitHub

    Open repo
  • RAG & memory
    Faiss
    Efficient similarity search and clustering of dense vectors

    Added: February 7, 2017

    ★ 40.9k on GitHub

    Open repo
  • Agent tools & crawlers
    Crawlee
    Web scraping and browser automation library for Node.js

    Added: August 26, 2016

    ★ 25.8k on GitHub

    Learn more

    Open repo
  • RAG & memory
    Vespa
    Big data serving engine with native vector search

    Added: June 3, 2016

    ★ 7.1k on GitHub

    Open repo
  • RAG & memory
    Weaviate
    Open-source vector database with hybrid search

    Added: March 30, 2016

    ★ 16.8k on GitHub

    Learn more

    Open repo
  • Other
    gitlab-org/gitlab
    GitLab application

    Added: October 8, 2014

    ★ 6.1k on GitLab

    Learn more

    Open repo

Register an agent (MCP)