infiniflow/ragflow
RAGFlow is an open-source Retrieval-Augmented Generation engine that leverages deep document understanding and Large Language Models to provide accurate, citation-backed question-answering from complex and diverse data sources.
Awesome AI Agents › NL AI Frameworks
AgentOps-AI/Jaiqu
Jaiqu is an AI-powered tool designed to automatically transform JSON data from any given schema into any desired schema using AI-generated jq queries. It leverages GPT-4 to iteratively create valid jq query syntax that maps data from a source JSON schema to a target schema, enabling seamless and repeatable JSON transformations. The project supports schema validation to ensure that the input JSON contains all required data fields as specified by the target schema. It also features fuzzy term matching, which uses semantic similarity to infer and map keys that may have different naming conventions between the input and output schemas, such as "datetime" versus "date_time". Jaiqu is particularly useful for developers and data engineers who need to automate the process of reshaping JSON data without manually writing complex jq queries. The tool is accessible via a Python package and includes a command-line interface for ease of use. Users can provide a JSON schema and input JSON data, and Jaiqu will validate the input against the schema and generate a jq query that extracts and transforms the data accordingly. The project also offers a live demo and video overview to help users understand its capabilities. The architecture of Jaiqu involves validating the input schema, generating jq filter queries for each key, compiling and testing these filters, and retrying if necessary until a valid jq query is produced. This ensures robustness and accuracy in the transformation process. Jaiqu is open-source under the MIT License and encourages contributions from the community. It supports Python versions 3.9 and 3.10 and integrates well with AI agent frameworks like AgentOps. Overall, Jaiqu simplifies the complex task of JSON data transformation by combining AI with jq query language, making it a powerful tool for data manipulation and integration workflows.
https://github.com/AgentOps-AI/Jaiqu
Also in NL AI Frameworks
ScrapeGraphAI/Scrapegraph-ai
ScrapeGraphAI is an AI-powered Python library that creates intelligent web scraping pipelines using large language models to extract structured data from websites and local documents efficiently.
pydantic/pydantic
Pydantic is a Python library for fast and extensible data validation using Python type hints, enabling developers to define and validate data models efficiently.
apache/doris
Apache Doris is a high-performance, real-time analytical database with a storage-compute integrated architecture, designed for sub-second query response and high concurrency in diverse data analysis scenarios.
business-science/ai-data-science-team
AI Data Science Team is a Python library featuring AI-powered agents that automate and accelerate common data science tasks, including data cleaning, feature engineering, machine learning, and exploratory data analysis, to improve productivity and efficiency.
ucbepic/docetl
DocETL is a system for creating and executing complex document processing and data transformation pipelines powered by large language models, featuring an interactive UI playground and a Python package for production use.
hitsz-ids/synthetic-data-generator
Synthetic Data Generator (SDG) is a comprehensive framework for generating high-quality, privacy-compliant synthetic structured tabular data using advanced statistical and LLM-based models, optimized for big data applications.
Mintplex-Labs/vector-admin
VectorAdmin is a universal and user-friendly tool suite for managing multiple vector databases, providing full control over vector data with multi-user support, embedding management, and cloud deployment capabilities.