Data agents

🔥 Search, scrape, and clean the web for AI agents.

Financial data platform for analysts, quants and AI agents.

Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic…

LlamaIndex is the leading document agent and OCR platform

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from…

TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for…

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box…

Search infrastructure for AI

AI agents, automations and apps that run your operations. Model agnostic.

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each…

A set of ready to use Agent Skills for research, science, engineering, analysis, finance and writing.

FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and…

Dolt – Git for Data

PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses…

Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

Open-source platform for creating safe, isolated production sandboxes for API, integration, and E2E testing.

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give…

这是一款提高ChatGPT的数据安全能力和效率的插件。并且免费共享大量创新功能，如：自动刷新、保持活跃、数据安全、取消审计、克隆对话、言无不尽、净化页面、展示大屏、拦截跟踪、日新月异、明察秋毫等。让我们的AI体验无比安全…

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming…

Analyze coding (agent) CLI token usage and costs from local data.

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

An open source, privacy focused alternative to NotebookLM for teams with no data limits. Join our Discord…

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the…

本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100%…

Code search MCP for Claude Code. Make entire codebase the context for any coding agent.

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and…

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your…

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

The all-in-one, open-source backend platform for agentic coding. InsForge gives your coding agent database…

The agent platform built on sync.

Incremental engine for long horizon agents 🌟 Star if you like it!

Your personal intelligence agent. Watches the world from multiple data sources and pings you when something…

Unopim is a free and open-source Laravel-based Product Information Management (PIM) system that helps…

AI Observability & Evaluation

A Python library for anomaly detection across tabular, time series, graph, text, and image data. 60+…

A lightweight, lightning-fast, in-process vector database

🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.

Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified…

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling…

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real…

⏰ Agenticly track worldwide conference deadlines (Website, Python Cli, Wechat Applet)

Open-source intelligence for the global theater. Track everything from the corporate/private jets of the…

Agent skill that generates rich HTML pages or slide decks for diagrams, diff reviews, plan audits, data…

Private & local AI personal knowledge management app for high entropy people.

A polyglot document intelligence framework with a Rust core. Extract text, metadata, images, and structured…

An EVM compatible Substrate chain, powered by StorageHub and secured by EigenLayer

🔍大模型应用开发实战一：RAG 技术全栈指南，在线阅读地址：https://datawhalechina.github.io/all-in-rag/

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

Universal SEO skill for Claude Code. 25 sub-skills + 18 sub-agents covering technical SEO, E-E-A-T, schema…

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral…

AI + Data, online. https://vespa.ai

Postgres with GPUs for ML/AI apps.

Turn any webpage into structured data using LLMs

AI quantitative trading platform for crypto, stocks, and forex with backtesting, live trading, market data…

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety…

Build ChatGPT over your data, all with natural language

Local-first chat history analyzer with AI. | 本地优先的 AI 聊天记录分析工具

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM…

Open-source context retrieval layer for AI agents

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

An open source deep research clone. AI Agent that reasons large amounts of web data extracted with Firecrawl

notes for software engineers getting up to speed on new AI developments. Serves as datastore for…

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in…

Build your own AI SRE agents. The open source toolkit for the AI era.

Agentic BI. Analytics at the speed of code ⚡️

Policy and data administration, distribution, and real-time updates on top of Policy Agents (OPA, Cedar, ...)

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

MineContext is your proactive context-aware AI partner（Context-Engineering+ChatGPT Pulse）

Superduper: End-to-end framework for building custom AI applications and agents.

An AI-powered data science team of agents to help you perform common data science tasks 10X faster.

Structured data extraction and instruction calling with ML, LLM and Vision LLM

✨ The agentic HTML editor — your local AI agent writes the HTML, you ship it. 🚀 75 Skills × 9 Surfaces…

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Build databases, automations, apps & agents with AI — no code. Open source platform available on cloud and…

A lightweight next-gen data explorer - Postgres, MySQL, SQLite, MongoDB, Redis, MariaDB, Elastic Search, and…

Neo4j graph construction from unstructured data using LLMs

An event-driven framework designed to build and orchestrate multi-agent AI systems. It enables seamless…

AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.

HelixDB is an open-source graph-vector database built from scratch in Rust.

Olares: An Open-Source Personal Cloud to Reclaim Your Data

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector…

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production…

SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence…

A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.

Knowledge Agents and Management in the Cloud

Learn Agentic AI using Dapr Agentic Cloud Ascent (DACA) Design Pattern and Agent-Native Cloud Technologies…

CSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both…

Local persistent memory store for LLM applications including claude desktop, github copilot, codex…

High-performance open-source in-memory graph database for GraphRAG, AI memory, agentic AI, and real-time…

TimeGPT-1: production ready pre-trained Time Series Foundation Model for forecasting and anomaly detection…

Easiest and laziest way for building multi-agent LLMs applications.

A system for agentic LLM-powered data processing and ETL

Interact with your SQL database, Natural Language to SQL using LLMs

Main repository for Datadog Agent

The most accurate document search and store for building AI apps

Mirix is a multi-agent personal assistant designed to track on-screen activities and answer user questions…

Superfast AI decision making and intelligent processing of multi-modal data.

Agent Skills as a Memory Layer

Lightweight and powerful workflow engine that comes with a Web UI. Define workflows in a declarative YAML…

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale…

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open…

Open Brain — The infrastructure layer for your thinking. One database, one AI gateway, one chat channel — any…

OP Vault ChatGPT: Give ChatGPT long-term memory using the OP Stack (OpenAI + Pinecone Vector Database)…

A quick guide (especially) for trending instruction finetuning datasets

Automatic Generation of Visualizations and Infographics using Large Language Models

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and…

Write tests against structured configuration data using the Open Policy Agent Rego query language

Technical resources for AI developers to build applications, agents, and systems using Oracle AI Database and…

Data framework for your LLM applications. Focus on server side solution

AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps…

A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI…

Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural…

Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data…

All-in-One Native Local Development Environment for Windows, macOS & Linux. Docker alternative for PHP…

Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)

Opinionated skills for AI coding agents to create stunning diagrams and visualizations directly in Markdown…

Zero-dependency, token-efficient database MCP server for Postgres, MySQL, SQL Server, MariaDB, SQLite.

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless…

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems…

The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

Database system for AI-powered apps

The fastest business intelligence tool for humans and agents.

The AI-native state store for agents. MySQL-compatible, embedded or server, hybrid vector + full-text search…

Modular SenseNova skills for building AI-powered office assistants and productivity workflows

Low latency web data collector

动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollama/

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

Terminal security for developers and AI agents. Intercepts homograph URLs, pipe-to-shell, ANSI injection…

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Label, clean and enrich text datasets with LLMs.

编程导航 2025 年 AI 开发实战新项目，基于 Spring Boot 3 + Java 21 + Spring AI 构建 AI 恋爱大师应用和 ReAct 模式自主规划智能体YuManus，覆盖 AI…

Distributed vector search for AI-native applications

Empowering RAG with a memory-based data interface for all-purpose applications!

The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more…

A lightweight, cross-platform database client for developers. Supports MySQL, PostgreSQL and SQLite. Hackable…

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR…

Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple…

Aix-DB 基于 LangChain/LangGraph 框架，结合 MCP Skills 多智能体协作架构，实现自然语言到数据洞察的端到端转换。

The agent runtime platform powered by context graphs.

A self-learning data agent built with systems engineering principles. It grounds answers in 6 layers of…

Agent harness to publish your history from Claude Code et al. as Huggingface datasets.

用于训练中英文对话系统的语料库 Datasets for Training Chatbot System

An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit…

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and…

All-in-one productivity app and AI assistant with Tasks, Notes, Calendar, Diary and Bookmarks.

Spring AI Alibaba DataAgent

Query your Apple Health data with natural language 💬 🩺

The PHP Agentic Framework to build production-ready AI driven applications. Connect components (LLMs, vector…

🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.

Apache ServiceComb Pack is an eventually data consistency solution for micro-service applications…

Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored…

Open-source persistent memory for AI agent pipelines (LangGraph, CrewAI, AutoGen) and Claude. REST API +…

FinRL­®-Meta: Dynamic datasets and market environments for FinRL.

AI-native HTAP database with Git-for-Data and built-in vector search, serving as the data and memory backbone…

Run Claude Code, Gemini, Codex — or any coding agent — in a clean, isolated sandbox with sensitive data…

airda(Air Data Agent)是面向数据分析的多智能体，能够理解数据开发和数据分析需求、理解数据、生成面向数据查询、数据可视化、机器学习等任务的SQL和Python代码

Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

Ruby gems for general-purpose AI agent systems: automation, research, data processing, customer support…

LLPhant - A comprehensive PHP Generative AI Framework using OpenAI GPT 4. Inspired by Langchain

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

Meet Ava, the WhatsApp Agent

Trench — Open-Source Analytics Infrastructure. A single production-ready Docker image built on ClickHouse…

A ChatGPT web client that supports multiple users, multiple languages, and multiple database connections for…

Backtestable AI trading agents and Python algorithmic trading strategies for stocks, options, crypto…

A straightforward method for training your LLM, from downloading data to generating text.

WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a…

[GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with…

Databricks Toolkit for Coding Agents provided by Field Engineering

Declarative and Incremental Backend for Multimodal AI Applications

A curated list of 100+ resources for building and deploying generative AI specifically focusing on helping…

自然语言处理（nlp），小姜机器人（闲聊检索式chatbot），BERT句向量-相似度（Sentence Similarity），XLNET句向量-相似度（text xlnet embedding），文本分类（Text…

A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data

Turn Chinese natural language into structured data 中文自然语言理解

Get clean data from tricky documents, powered by vision-language models ⚡

🤖 AI-native Visual Analytics framework build for agents.

Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms…

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of…

A hyper-fast local vector database for use with LLM Agents. Now accepting SAFEs at $135M cap.

AI agent skills for App Store Optimization (ASO) and app marketing. Built for indie developers, app…

AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright…

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥

Ground truth layer for humans and AI agents working together. Version control for knowledge.

An AI knowledge base/agent built with .Net 9, AntBlazor, Semantic Kernel, and Kernel Memory, supporting local…

AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI…

The Apify MCP server enables your AI agents to extract data from social media, search engines, maps…

The Future of Data Engineering — A CLI SQL client for the modern data stack, enabling AI-native context…

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

A framework for comprehensive diagnosis and optimization of agents using simulated, realistic synthetic…

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust…

🦜⛏️ Did you say you like data?

🔥 AI-powered data enrichment tool that transforms emails into rich datasets with company profiles, funding…

A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying…

Thoth - Personal AI Sovereignty. A local-first AI assistant with integrated tools, a personal knowledge…

🐙 Give your AI a life — open-source agent infrastructure for team collaboration.