infiniflow/ragflow
RAGFlow is an open-source Retrieval-Augmented Generation engine that leverages deep document understanding and Large Language Models to provide accurate, citation-backed question-answering from complex and diverse data sources.
Awesome AI Agents › NL AI Frameworks
Mintplex-Labs/vector-admin
VectorAdmin by Mintplex Labs is a comprehensive and universal tool suite designed for managing vector databases such as Pinecone, Chroma, Qdrant, and Weaviate. It provides a user-friendly graphical interface and a suite of tools that simplify the management, viewing, updating, and deletion of vectorized text data embedded in these databases. The project aims to offer full control over vector data, which is often difficult to manage through traditional API calls or tools like LangChain that do not provide visibility into stored embeddings. The application supports multi-user instances, allowing oversight and permission management for data access. Users can atomically manage individual text chunks of embeddings, copy entire documents or namespaces without re-embedding costs, upload and embed new documents directly, and migrate vector databases between different types or instances (with some features still in progress). It is designed to be cloud deployment ready and supports multiple concurrent vector databases. VectorAdmin is structured as a monorepo with several components: a Flask-based document processor for parsing and embedding documents, a React and ViteJS frontend for user interaction, a NodeJS and Express backend for database management, and an InngestJS worker system for handling background tasks efficiently. The entire stack can be deployed easily using Docker. The project requires Node.js, Yarn, Python 3.9+, and access to OpenAI API keys for embedding updates. It supports integration with Pinecone and ChromaDB, among others. Despite being no longer actively maintained by Mintplex Labs, the project remains self-hostable and functional for most providers. VectorAdmin also includes features like automated regression testing to ensure response quality, full API and client support for JavaScript, Python, and LangChain integration, and cost-saving measures to avoid redundant embedding of large documents. It collects anonymous telemetry data to improve the product but allows users to opt out. Overall, VectorAdmin is a powerful, scalable, and user-friendly solution for managing vector databases, aimed at making vector data accessible and manageable without compromising on control or efficiency.
https://github.com/Mintplex-Labs/vector-admin
Also in NL AI Frameworks
ScrapeGraphAI/Scrapegraph-ai
ScrapeGraphAI is an AI-powered Python library that creates intelligent web scraping pipelines using large language models to extract structured data from websites and local documents efficiently.
pydantic/pydantic
Pydantic is a Python library for fast and extensible data validation using Python type hints, enabling developers to define and validate data models efficiently.
apache/doris
Apache Doris is a high-performance, real-time analytical database with a storage-compute integrated architecture, designed for sub-second query response and high concurrency in diverse data analysis scenarios.
business-science/ai-data-science-team
AI Data Science Team is a Python library featuring AI-powered agents that automate and accelerate common data science tasks, including data cleaning, feature engineering, machine learning, and exploratory data analysis, to improve productivity and efficiency.
ucbepic/docetl
DocETL is a system for creating and executing complex document processing and data transformation pipelines powered by large language models, featuring an interactive UI playground and a Python package for production use.
hitsz-ids/synthetic-data-generator
Synthetic Data Generator (SDG) is a comprehensive framework for generating high-quality, privacy-compliant synthetic structured tabular data using advanced statistical and LLM-based models, optimized for big data applications.
scouter-project/scouter
Scouter is an open source Application Performance Management (APM) tool that monitors and manages the performance of software applications and system resources across various platforms and services.