run-llama/llama_index
LlamaIndex is a leading data framework that enables building LLM-powered applications by providing tools for data ingestion, structuring, and advanced querying to augment large language models with private and external data.
Awesome AI Agents › Data Integration and Specialized Solutions
pingcap/tidb
TiDB, pronounced "Tai-DB" (Titanium DataBase), is a robust open-source, cloud-native, distributed SQL database developed by PingCAP. It's engineered to handle large-scale, unpredictable workloads with strong ACID guarantees, making it suitable for critical enterprise applications. Key features include distributed transactions, which ensure data correctness and consistency across multiple nodes, even during network partitions or node failures, thanks to its two-phase commit protocol. The database offers both horizontal and vertical scalability, allowing users to expand resources without downtime by independently scaling computing and storage units. High availability is built-in through the Raft consensus protocol, providing automated failover and data replication for disaster tolerance. TiDB is also a Hybrid Transactional/Analytical Processing (HTAP) database, combining a row-based storage engine (TiKV) for transactions and a columnar storage engine (TiFlash) for analytics, with real-time data consistency between them. Its cloud-native design supports deployments in public clouds, on-premises, or via Kubernetes using TiDB Operator, and a fully managed service is available through TiDB Cloud. Significantly, TiDB is highly compatible with MySQL 8.0, simplifying migrations and allowing the use of familiar tools and frameworks, while maintaining a strong commitment to open-source development under the Apache 2.0 license.
https://github.com/pingcap/tidb
Also in Data Integration and Specialized Solutions
getzep/graphiti
Graphiti is a framework for building and querying real-time, temporally-aware knowledge graphs designed to support AI agents in dynamic environments with efficient incremental updates and hybrid retrieval methods.
dolthub/dolt
Dolt is a SQL database with Git-like features, enabling full version control over data, including branching, merging, and diffing of data.
vectordotdev/vector
Vector is a high-performance, end-to-end observability data pipeline designed to collect, transform, and route logs, metrics, and traces.
cube-js/cube
Cube Core is an open-source semantic layer that enables AI, business intelligence, and embedded analytics by providing a flexible, API-driven platform supporting multiple SQL data sources and real-time analytics.
llmware-ai/llmware
llmware is a unified framework for building enterprise Retrieval-Augmented Generation (RAG) pipelines using small, specialized language models integrated with secure knowledge sources for efficient AI applications.
cocoindex-io/cocoindex
CoCoIndex is an ultra-performant data transformation framework for AI, specializing in incremental processing for data indexing and real-time semantic search with Python and Rust.
electric-sql/electric
Electric is a Postgres sync engine that provides real-time data synchronization, partial replication, and data delivery for modern applications and AI agents.